Sep 07 17:53:49 devstack cinder-volume[75872]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 07 17:53:49 devstack cinder-volume[75872]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 07 17:53:49 devstack cinder-volume[75872]: we strongly recommend against using it for new projects.
Sep 07 17:53:49 devstack cinder-volume[75872]: If you are already using Eventlet, we recommend migrating to a different
Sep 07 17:53:49 devstack cinder-volume[75872]: framework.  For more detail see
Sep 07 17:53:49 devstack cinder-volume[75872]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 07 17:53:49 devstack cinder-volume[75872]:   import eventlet  # noqa
Sep 07 17:53:52 devstack cinder-volume[75872]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75872) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 07 17:53:52 devstack cinder-volume[75872]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75872) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 07 17:53:52 devstack cinder-volume[75872]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75872) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 07 17:53:53 devstack cinder-volume[75872]: INFO dbcounter [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Registered counter for database cinder
Sep 07 17:53:53 devstack cinder-volume[75872]: DEBUG oslo_db.sqlalchemy.engines [None req-be7dc310-a335-490c-ac65-026bbade331a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75872) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 07 17:53:53 devstack cinder-volume[75872]: DEBUG dbcounter [-] [75872] Writer thread running {{(pid=75872) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 07 17:53:53 devstack cinder-volume[75872]: INFO cinder.rpc [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 07 17:53:53 devstack cinder-volume[75872]: INFO cinder.rpc [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 07 17:53:53 devstack cinder-volume[75872]: DEBUG oslo_db.sqlalchemy.engines [None req-be7dc310-a335-490c-ac65-026bbade331a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75872) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 07 17:53:53 devstack cinder-volume[75872]: INFO cinder.volume.manager [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Determined volume DB was empty at startup.
Sep 07 17:53:53 devstack cinder-volume[75872]: DEBUG cinder.volume.manager [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75872) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 07 17:53:53 devstack cinder-volume[75872]: INFO cinder.volume.manager [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 07 17:53:53 devstack cinder-volume[75872]: WARNING stevedore.named [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 07 17:53:53 devstack cinder-volume[75872]: WARNING castellan.key_manager [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 07 17:53:53 devstack cinder-volume[75872]: WARNING cinder.keymgr.conf_key_mgr [None req-be7dc310-a335-490c-ac65-026bbade331a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 07 17:53:53 devstack cinder-volume[75872]: DEBUG cinder.volume.drivers.lvm [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75872) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Sep 07 17:53:53 devstack cinder-volume[75872]: DEBUG oslo_concurrency.processutils [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75872) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_concurrency.processutils [None req-be7dc310-a335-490c-ac65-026bbade331a None None] CMD "cinder-rtstool verify" returned: 0 in 0.395s {{(pid=75872) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_db.sqlalchemy.engines [None req-be7dc310-a335-490c-ac65-026bbade331a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75872) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 07 17:53:54 devstack cinder-volume[75872]: INFO cinder.rpc [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 07 17:53:54 devstack cinder-volume[75872]: INFO cinder.rpc [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 07 17:53:54 devstack cinder-volume[75872]: WARNING stevedore.named [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 07 17:53:54 devstack cinder-volume[75872]: WARNING castellan.key_manager [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 07 17:53:54 devstack cinder-volume[75872]: INFO cinder.volume.manager [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_db.sqlalchemy.engines [None req-be7dc310-a335-490c-ac65-026bbade331a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75872) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 07 17:53:54 devstack cinder-volume[75872]: INFO oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Starting 1 workers
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Started child 76057 {{(pid=75872) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Full set of CONF: {{(pid=75872) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] ******************************************************************************** {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Configuration options gathered from: {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] ================================================================================ {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] allow_availability_zone_fallback = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] allow_compression_on_image_upload = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] allowed_direct_url_schemes     = [] {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] api_rate_limit                 = True {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] auth_strategy                  = keystone {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] az_cache_duration              = 3600 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_availability_zone      = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_host                   = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_name                   = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_stats_polling_interval = 60 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backup_api_class               = cinder.backup.api.API {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backup_name_template           = backup-%s {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backup_use_same_host           = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backup_use_temp_snapshot       = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] chap_password                  = **** {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] chap_username                  =  {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cinder_internal_tenant_project_id = 2fa748cbec7a4142b1ea91f491d6f90f {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cinder_internal_tenant_user_id = 4e661a4618c540b6a4eab4428e257dc3 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cloned_volume_same_az          = True {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cluster                        = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[76057]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] compression_format             = gzip {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] compute_api_class              = cinder.compute.nova.API {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] config_dir                     = [] {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] config_source                  = [] {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] control_exchange               = openstack {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] debug                          = True {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] default_availability_zone      = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] default_group_type             = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] default_volume_type            = lvmdriver-1 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] disk_geometry                  = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] driver_client_cert             = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] driver_client_cert_key         = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] driver_data_namespace          = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] driver_ssl_cert_path           = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] driver_ssl_cert_verify         = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] driver_use_ssl                 = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] enable_force_upload            = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] enable_new_services            = True {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] enable_unsupported_driver      = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] enforce_multipath_for_image_xfer = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] filter_function                = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] glance_api_insecure            = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] glance_api_servers             = ['http://192.168.122.66/image'] {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] glance_api_ssl_compression     = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] glance_ca_certificates_file    = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] glance_catalog_info            = image:glance:publicURL {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] glance_certfile                = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] glance_keyfile                 = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] glance_num_retries             = 3 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] glance_request_timeout         = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] goodness_function              = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] graceful_shutdown_timeout      = 5 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] group_api_class                = cinder.group.api.API {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] host                           = devstack {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] image_compress_on_upload       = True {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] image_conversion_address_space_limit = 1 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] image_conversion_cpu_limit     = 60 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] image_conversion_disable       = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] image_upload_use_cinder_backend = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] image_upload_use_internal_tenant = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] image_volume_cache_enabled     = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] image_volume_cache_max_count   = 0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] image_volume_cache_max_size_gb = 0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] init_host_max_objects_retrieval = 0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] instance_format                = [instance: %(uuid)s]  {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] iscsi_target_flags             =  {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] iscsi_write_cache              = on {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] iser_helper                    = tgtadm {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] iser_ip_address                = 192.168.122.66 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] iser_port                      = 3260 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] log_color                      = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] log_config_append              = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] log_dir                        = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] log_file                       = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] log_options                    = True {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] log_rotate_interval            = 1 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] log_rotate_interval_type       = days {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] log_rotation_type              = none {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] max_age                        = 0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] max_logfile_count              = 30 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] max_logfile_size_mb            = 200 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] max_over_subscription_ratio    = 20.0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] message_reap_interval          = 86400 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] message_ttl                    = 2592000 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] migration_create_volume_timeout_secs = 300 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] monkey_patch                   = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] monkey_patch_modules           = [] {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] my_ip                          = 192.168.122.66 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] no_snapshot_gb_quota           = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] num_iser_scan_tries            = 3 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] num_shell_tries                = 3 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] num_volume_device_scan_tries   = 3 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] nvmeof_conn_info_version       = 1 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] nvmet_ns_id                    = 10 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] nvmet_port_id                  = 1 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] osapi_max_limit                = 1000 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] osapi_volume_ext_list          = [] {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] osapi_volume_listen_port       = 8776 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] osapi_volume_use_ssl           = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] osapi_volume_workers           = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] per_volume_size_limit          = -1 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] periodic_fuzzy_delay           = 60 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] periodic_interval              = 60 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] public_endpoint                = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] publish_errors                 = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] quota_backup_gigabytes         = 1000 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] quota_backups                  = 10 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] quota_gigabytes                = 1000 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] quota_groups                   = 10 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] quota_snapshots                = 10 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] quota_volumes                  = 10 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] rate_limit_burst               = 0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] rate_limit_except_level        = CRITICAL {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] rate_limit_interval            = 0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] reinit_driver_count            = 3 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] replication_device             = **** {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] report_discard_supported       = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] report_interval                = 120 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] reservation_clean_interval     = 86400 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] reservation_expire             = 86400 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] reserved_image_namespaces      = [] {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] reserved_percentage            = 0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] rpc_response_timeout           = 120 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] run_external_periodic_tasks    = True {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] scst_target_driver             = iscsi {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] scst_target_iqn_name           = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] service_down_time              = 720 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] shell_completion               = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] snapshot_name_template         = snapshot-%s {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] snapshot_same_host             = True {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] split_loggers                  = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] state_path                     = /opt/stack/data/cinder {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[76057]: INFO cinder.volume.manager [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] storage_availability_zone      = nova {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] storage_protocol               = iSCSI {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] syslog_log_facility            = LOG_USER {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] target_helper                  = lioadm {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] target_ip_address              = 192.168.122.66 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] target_port                    = 3260 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] target_protocol                = iscsi {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] target_secondary_ip_addresses  = [] {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] trace_flags                    = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] transport_url                  = **** {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] until_refresh                  = 0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] use_chap_auth                  = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] use_default_quota_class        = True {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] use_journal                    = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] use_json                       = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] use_multipath_for_image_xfer   = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] use_stderr                     = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] use_syslog                     = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] verify_glance_signatures       = enabled {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] volume_api_class               = cinder.volume.api.API {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] volume_backend_name            = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] volume_clear                   = zero {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] volume_clear_ionice            = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] volume_clear_size              = 0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] volume_copy_bps_limit          = 0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] volume_dd_blocksize            = 1M {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] volume_name_template           = volume-%s {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] volume_service_inithost_offload = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] volume_usage_audit_period      = month {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] zoning_mode                    = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_concurrency.disable_process_locking = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.auth_section = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.auth_type   = password {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.auth_version = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.cache       = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.certfile    = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.delay_auth_decision = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.http_connect_timeout = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.include_service_catalog = True {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.insecure    = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.interface   = public {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.keyfile     = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.memcache_password = **** {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.memcache_username = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.region_name = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.service_token_roles_required = True {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.service_type = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.token_cache_time = 300 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.66/identity {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.backend                  = dogpile.cache.null {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.backend_argument         = **** {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.backend_expiration_time  = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.config_prefix            = cache.oslo {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.debug_cache_backend      = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.enable_retry_client      = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.enable_socket_keepalive  = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.enabled                  = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.expiration_time          = 600 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.hashclient_retry_attempts = 2 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.memcache_dead_retry      = 300 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.memcache_pool_maxsize    = 10 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.memcache_sasl_enabled    = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.password                 = **** {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.proxies                  = [] {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.redis_db                 = 0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.redis_sentinel_service_name = mymaster {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.redis_server             = localhost:6379 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.retry_attempts           = 2 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.retry_delay              = 0.0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.socket_keepalive_count   = 1 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.socket_keepalive_idle    = 1 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.socket_keepalive_interval = 1 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.socket_timeout           = 1.0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.tls_allowed_ciphers      = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.tls_cafile               = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.tls_certfile             = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.tls_enabled              = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.tls_keyfile              = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cache.username                 = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] coordination.backend_url       = **** {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] database.asyncio_connection    = **** {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] database.asyncio_slave_connection = **** {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] database.backend               = sqlalchemy {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] database.connection            = **** {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] database.connection_debug      = 0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] database.connection_parameters =  {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] database.connection_recycle_time = 3600 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] database.connection_trace      = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] database.db_inc_retry_interval = True {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] database.db_max_retries        = 20 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:53:54 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] database.db_max_retry_interval = 10 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] database.db_retry_interval     = 1 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] database.max_overflow          = 50 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] database.max_pool_size         = 5 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] database.max_retries           = 10 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] database.mysql_wsrep_sync_wait = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] database.pool_timeout          = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] database.retry_interval        = 10 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] database.slave_connection      = **** {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] database.sqlite_synchronous    = True {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] database.synchronous_reader    = True {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] database.use_db_reconnect      = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_tracing.insecure = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack sudo[76061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] profiler.connection_string     = messaging:// {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] profiler.enabled               = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] profiler.es_doc_type           = notification {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack sudo[76061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] profiler.es_scroll_size        = 10000 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] profiler.es_scroll_time        = 2m {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] profiler.filter_error_trace    = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] profiler.hmac_keys             = **** {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] profiler.sentinel_service_name = mymaster {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] profiler.socket_timeout        = 0.1 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] profiler.trace_requests        = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] profiler.trace_sqlalchemy      = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] profiler_jaeger.process_tags   = {} {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] profiler_jaeger.service_name_prefix = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] profiler_otlp.service_name_prefix = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_policy.enforce_new_defaults = True {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_policy.policy_default_rule = default {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_policy.policy_file        = policy.yaml {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] privsep_osbrick.group          = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] privsep_osbrick.helper_command = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] privsep_osbrick.user           = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cinder_sys_admin.group         = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cinder_sys_admin.helper_command = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] cinder_sys_admin.user          = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] service_user.auth_section      = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] service_user.auth_type         = password {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] service_user.cafile            = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] service_user.certfile          = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] service_user.collect_timing    = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] service_user.insecure          = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] service_user.keyfile           = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] service_user.send_service_user_token = True {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] service_user.split_loggers     = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] service_user.timeout           = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] service_user.tls_ciphers       = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] service_user.tls_min_version   = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] glance.auth_section            = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] glance.auth_type               = password {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] glance.certfile                = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] glance.collect_timing          = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] glance.insecure                = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] glance.keyfile                 = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] glance.region_name             = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] glance.split_loggers           = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] glance.timeout                 = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] glance.tls_ciphers             = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] glance.tls_min_version         = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.backend_availability_zone = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.chap_password = **** {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.chap_username =  {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.disk_geometry = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.driver_client_cert = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.driver_client_cert_key = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.driver_data_namespace = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.driver_use_ssl = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.enable_unsupported_driver = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.extra_capabilities = {} {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.filter_function = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.goodness_function = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.iscsi_target_flags =  {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.iscsi_write_cache = on {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.iser_helper   = tgtadm {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.iser_ip_address = 192.168.122.66 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.iser_port     = 3260 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.lvm_share_target = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.lvm_type      = auto {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.num_shell_tries = 3 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.nvmet_port_id = 1 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.replication_device = **** {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.report_discard_supported = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.reserved_percentage = 0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.scst_target_driver = iscsi {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.scst_target_iqn_name = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.storage_protocol = iSCSI {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.target_helper = tgtadm {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.target_ip_address = 192.168.122.66 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.target_port   = 3260 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.target_protocol = iscsi {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.trace_flags   = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.unique_fqdn_network = True {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.use_chap_auth = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.volume_backend_name = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.volume_clear  = zero {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.volume_clear_ionice = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.volume_clear_size = 0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_reports.file_event_handler = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_reports.log_dir           = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.backend_availability_zone = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.backend_host       = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.chap_password      = **** {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.chap_username      = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.disk_geometry      = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.driver_client_cert = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.driver_data_namespace = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.extra_capabilities = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.filter_function    = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.goodness_function  = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.iser_helper        = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.iser_ip_address    = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.iser_port          = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.iser_target_prefix = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.lvm_share_target   = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.lvm_type           = auto {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.num_shell_tries    = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.replication_device = **** {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.report_discard_supported = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.reserved_percentage = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.scst_target_driver = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.storage_protocol   = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.target_helper      = lioadm {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.target_ip_address  = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.target_port        = 3260 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.trace_flags        = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.use_chap_auth      = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.volume_clear       = zero {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.volume_clear_size  = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] lvmdriver-1.volumes_dir        = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.ssl      = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_notifications.driver = [] {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_notifications.retry = -1 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] oslo_messaging_notifications.transport_url = **** {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] key_manager.fixed_key          = **** {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican.barbican_api_version  = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican.barbican_endpoint     = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican.barbican_endpoint_type = public {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican.barbican_region_name  = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican.cafile                = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican.certfile              = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican.collect_timing        = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican.insecure              = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican.keyfile               = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican.number_of_retries     = 60 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican.retry_delay           = 1 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican.send_service_user_token = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican.split_loggers         = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican.timeout               = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican.tls_ciphers           = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican.tls_min_version       = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican.verify_ssl            = True {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican.verify_ssl_path       = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican_service_user.auth_section = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican_service_user.auth_type = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican_service_user.cafile   = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican_service_user.certfile = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican_service_user.collect_timing = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican_service_user.insecure = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican_service_user.keyfile  = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican_service_user.split_loggers = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican_service_user.timeout  = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican_service_user.tls_ciphers = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] barbican_service_user.tls_min_version = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] vault.approle_role_id          = **** {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] vault.approle_secret_id        = **** {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] vault.auth_method              = approle {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] vault.auth_path                = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] vault.kv_mountpoint            = secret {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] vault.kv_path                  = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] vault.kv_version               = 2 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] vault.namespace                = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] vault.root_token_id            = **** {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] vault.ssl_ca_crt_file          = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] vault.timeout                  = 60.0 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] vault.token_file               = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] vault.token_role               = None {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] vault.use_ssl                  = False {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:53:54 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] ******************************************************************************** {{(pid=75872) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 07 17:53:55 devstack sudo[76061]: pam_unix(sudo:session): session closed for user root
Sep 07 17:53:55 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.348s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:53:55 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:53:55 devstack sudo[76114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 07 17:53:55 devstack sudo[76114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:53:55 devstack sudo[76114]: pam_unix(sudo:session): session closed for user root
Sep 07 17:53:55 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.301s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:53:55 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 07 17:53:55 devstack cinder-volume[76057]: INFO cinder.brick.local_dev.lvm [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 07 17:53:55 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:53:55 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:53:55 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:53:55 devstack sudo[76226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 07 17:53:55 devstack sudo[76226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:53:55 devstack sudo[76226]: pam_unix(sudo:session): session closed for user root
Sep 07 17:53:55 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:53:55 devstack cinder-volume[76057]: DEBUG cinder.brick.local_dev.lvm [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76057) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Sep 07 17:53:55 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:53:55 devstack sudo[76317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 07 17:53:55 devstack sudo[76317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:53:56 devstack sudo[76317]: pam_unix(sudo:session): session closed for user root
Sep 07 17:53:56 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.516s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:53:56 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:53:56 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:53:56 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:53:56 devstack sudo[76503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 07 17:53:56 devstack sudo[76503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:53:56 devstack sudo[76503]: pam_unix(sudo:session): session closed for user root
Sep 07 17:53:56 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:53:56 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:53:56 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:53:56 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:53:56 devstack sudo[76590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 07 17:53:56 devstack sudo[76590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:53:56 devstack sudo[76590]: pam_unix(sudo:session): session closed for user root
Sep 07 17:53:56 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.288s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:53:56 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:53:56 devstack sudo[76674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 07 17:53:56 devstack sudo[76674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:53:57 devstack sudo[76674]: pam_unix(sudo:session): session closed for user root
Sep 07 17:53:57 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:53:57 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:53:57 devstack sudo[76677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 07 17:53:57 devstack sudo[76677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:53:57 devstack sudo[76677]: pam_unix(sudo:session): session closed for user root
Sep 07 17:53:57 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:53:57 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:53:57 devstack sudo[76761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 07 17:53:57 devstack sudo[76761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:53:57 devstack sudo[76761]: pam_unix(sudo:session): session closed for user root
Sep 07 17:53:57 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:53:57 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:53:57 devstack sudo[76764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 07 17:53:57 devstack sudo[76764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:53:57 devstack sudo[76764]: pam_unix(sudo:session): session closed for user root
Sep 07 17:53:57 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.293s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:53:57 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:53:57 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:53:57 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:53:57 devstack sudo[76811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 07 17:53:57 devstack sudo[76811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:53:58 devstack sudo[76811]: pam_unix(sudo:session): session closed for user root
Sep 07 17:53:58 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.305s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:53:58 devstack cinder-volume[76057]: INFO cinder.volume.drivers.lvm [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 07 17:53:58 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:53:58 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:53:58 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:53:58 devstack sudo[76864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 07 17:53:58 devstack sudo[76864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:53:58 devstack sudo[76864]: pam_unix(sudo:session): session closed for user root
Sep 07 17:53:58 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.239s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:53:58 devstack cinder-volume[76057]: DEBUG cinder.volume.drivers.lvm [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Updating volume stats {{(pid=76057) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 07 17:53:58 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:53:58 devstack sudo[76867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 07 17:53:58 devstack sudo[76867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:53:58 devstack sudo[76867]: pam_unix(sudo:session): session closed for user root
Sep 07 17:53:58 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:53:58 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:53:58 devstack sudo[76870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 07 17:53:58 devstack sudo[76870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:53:58 devstack sudo[76870]: pam_unix(sudo:session): session closed for user root
Sep 07 17:53:59 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:53:59 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:53:59 devstack sudo[76873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 07 17:53:59 devstack sudo[76873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:53:59 devstack sudo[76873]: pam_unix(sudo:session): session closed for user root
Sep 07 17:53:59 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:53:59 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:53:59 devstack sudo[76876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 07 17:53:59 devstack sudo[76876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:53:59 devstack sudo[76876]: pam_unix(sudo:session): session closed for user root
Sep 07 17:53:59 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:53:59 devstack cinder-volume[76057]: INFO cinder.volume.driver [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Driver hasn't implemented _init_vendor_properties()
Sep 07 17:53:59 devstack cinder-volume[76057]: DEBUG cinder.volume.driver [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76057) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 07 17:53:59 devstack cinder-volume[76057]: DEBUG oslo_db.sqlalchemy.engines [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76057) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 07 17:53:59 devstack cinder-volume[76057]: DEBUG dbcounter [-] [76057] Writer thread running {{(pid=76057) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 07 17:53:59 devstack cinder-volume[76057]: DEBUG cinder.db.api [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Building query based on filter {{(pid=76057) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 07 17:53:59 devstack cinder-volume[76057]: DEBUG cinder.image.image_utils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76057) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Sep 07 17:53:59 devstack cinder-volume[76057]: INFO cinder.keymgr.migration [None req-08f0fb8f-a657-4b75-99ab-8fb267e3088a None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 07 17:53:59 devstack cinder-volume[76057]: DEBUG cinder.volume.drivers.lvm [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Updating volume stats {{(pid=76057) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 07 17:53:59 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:53:59 devstack sudo[76879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 07 17:53:59 devstack sudo[76879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:53:59 devstack sudo[76879]: pam_unix(sudo:session): session closed for user root
Sep 07 17:53:59 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:53:59 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:53:59 devstack sudo[76882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 07 17:53:59 devstack sudo[76882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:54:00 devstack sudo[76882]: pam_unix(sudo:session): session closed for user root
Sep 07 17:54:00 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:54:00 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:54:00 devstack sudo[76887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 07 17:54:00 devstack sudo[76887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:54:00 devstack sudo[76887]: pam_unix(sudo:session): session closed for user root
Sep 07 17:54:00 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:54:00 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:54:00 devstack sudo[76890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 07 17:54:00 devstack sudo[76890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:54:00 devstack sudo[76890]: pam_unix(sudo:session): session closed for user root
Sep 07 17:54:00 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.335s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:54:00 devstack cinder-volume[76057]: DEBUG cinder.manager [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Notifying Schedulers of capabilities ... {{(pid=76057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 17:54:00 devstack cinder-volume[76057]: INFO cinder.volume.manager [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Driver initialization completed successfully.
Sep 07 17:54:00 devstack cinder-volume[76057]: INFO cinder.manager [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Initiating service 2 cleanup
Sep 07 17:54:00 devstack cinder-volume[76057]: INFO cinder.manager [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Service 2 cleanup completed.
Sep 07 17:54:00 devstack cinder-volume[76057]: DEBUG cinder.service [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Creating RPC server for service cinder-volume {{(pid=76057) start /opt/stack/cinder/cinder/service.py:231}}
Sep 07 17:54:00 devstack cinder-volume[76057]: DEBUG cinder.service [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76057) start /opt/stack/cinder/cinder/service.py:237}}
Sep 07 17:54:00 devstack cinder-volume[76057]: INFO cinder.volume.manager [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 07 17:54:00 devstack cinder-volume[76057]: DEBUG cinder.volume.drivers.lvm [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Updating volume stats {{(pid=76057) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 07 17:54:00 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:54:01 devstack sudo[76894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 07 17:54:01 devstack sudo[76894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:54:01 devstack sudo[76894]: pam_unix(sudo:session): session closed for user root
Sep 07 17:54:01 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:54:01 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:54:01 devstack sudo[76900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 07 17:54:01 devstack sudo[76900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:54:01 devstack sudo[76900]: pam_unix(sudo:session): session closed for user root
Sep 07 17:54:01 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:54:01 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:54:01 devstack sudo[76905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 07 17:54:01 devstack sudo[76905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:54:01 devstack sudo[76905]: pam_unix(sudo:session): session closed for user root
Sep 07 17:54:01 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:54:01 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:54:01 devstack sudo[76908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 07 17:54:01 devstack sudo[76908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:54:02 devstack sudo[76908]: pam_unix(sudo:session): session closed for user root
Sep 07 17:54:02 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:54:02 devstack cinder-volume[76057]: INFO cinder.volume.manager [None req-7cc7c1bf-7d24-4b24-94ae-0bcded418fb9 None None] Driver post RPC initialization completed successfully.
Sep 07 17:54:04 devstack cinder-volume[75872]: DEBUG dbcounter [-] [75872] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75872) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 17:54:06 devstack cinder-volume[76057]: DEBUG oslo_service.periodic_task [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Running periodic task VolumeManager._thread_info {{(pid=76057) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 17:54:06 devstack cinder-volume[76057]: DEBUG cinder.volume.manager [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] thread count: 6 {{(pid=76057) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 07 17:54:06 devstack cinder-volume[76057]: DEBUG cinder.volume.manager [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] thread info: [<_MainThread(MainThread, started 140531199955072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140531086445568)>, <Thread(Thread-3 (stat_writer), started daemon 140531086302784)>, <Thread(Rabbit-heartbeat, started daemon 140531084968576)>, <Thread(Thread-5 (_runner), started daemon 140531085018560)>, <Thread(Thread-7 (_runner), started daemon 140531085031104)>] {{(pid=76057) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 07 17:54:12 devstack cinder-volume[76057]: DEBUG dbcounter [-] [76057] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76057) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 17:54:12 devstack cinder-volume[76057]: DEBUG dbcounter [-] [76057] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=76057) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 17:55:06 devstack cinder-volume[76057]: DEBUG oslo_service.periodic_task [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76057) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 17:55:06 devstack cinder-volume[76057]: DEBUG cinder.volume.drivers.lvm [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Updating volume stats {{(pid=76057) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 07 17:55:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:55:06 devstack sudo[79295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 07 17:55:06 devstack sudo[79295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:55:06 devstack sudo[79295]: pam_unix(sudo:session): session closed for user root
Sep 07 17:55:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:55:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:55:06 devstack sudo[79298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 07 17:55:06 devstack sudo[79298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:55:06 devstack sudo[79298]: pam_unix(sudo:session): session closed for user root
Sep 07 17:55:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:55:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:55:06 devstack sudo[79301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 07 17:55:06 devstack sudo[79301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:55:06 devstack sudo[79301]: pam_unix(sudo:session): session closed for user root
Sep 07 17:55:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:55:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:55:06 devstack sudo[79304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 07 17:55:06 devstack sudo[79304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:55:07 devstack sudo[79304]: pam_unix(sudo:session): session closed for user root
Sep 07 17:55:07 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:55:07 devstack cinder-volume[76057]: DEBUG cinder.manager [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Notifying Schedulers of capabilities ... {{(pid=76057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 17:55:07 devstack cinder-volume[76057]: DEBUG oslo_service.periodic_task [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Running periodic task VolumeManager._thread_info {{(pid=76057) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 17:55:07 devstack cinder-volume[76057]: DEBUG cinder.volume.manager [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] thread count: 6 {{(pid=76057) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 07 17:55:07 devstack cinder-volume[76057]: DEBUG cinder.volume.manager [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] thread info: [<_MainThread(MainThread, started 140531199955072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140531086445568)>, <Thread(Thread-3 (stat_writer), started daemon 140531086302784)>, <Thread(Rabbit-heartbeat, started daemon 140531084968576)>, <Thread(Thread-5 (_runner), started daemon 140531085018560)>, <Thread(Thread-7 (_runner), started daemon 140531085031104)>] {{(pid=76057) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 07 17:56:06 devstack cinder-volume[76057]: DEBUG oslo_service.periodic_task [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76057) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 17:56:06 devstack cinder-volume[76057]: DEBUG cinder.volume.drivers.lvm [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Updating volume stats {{(pid=76057) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 07 17:56:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:56:06 devstack sudo[82736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 07 17:56:06 devstack sudo[82736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:56:06 devstack sudo[82736]: pam_unix(sudo:session): session closed for user root
Sep 07 17:56:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:56:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:56:06 devstack sudo[82740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 07 17:56:06 devstack sudo[82740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:56:06 devstack sudo[82740]: pam_unix(sudo:session): session closed for user root
Sep 07 17:56:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:56:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:56:06 devstack sudo[82747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 07 17:56:06 devstack sudo[82747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:56:06 devstack sudo[82747]: pam_unix(sudo:session): session closed for user root
Sep 07 17:56:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:56:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:56:06 devstack sudo[82751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 07 17:56:06 devstack sudo[82751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:56:07 devstack sudo[82751]: pam_unix(sudo:session): session closed for user root
Sep 07 17:56:07 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:56:07 devstack cinder-volume[76057]: DEBUG cinder.manager [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Notifying Schedulers of capabilities ... {{(pid=76057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 17:56:12 devstack cinder-volume[76057]: DEBUG dbcounter [-] [76057] Writing DB stats cinder:SELECT=1 {{(pid=76057) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 17:56:12 devstack cinder-volume[76057]: DEBUG dbcounter [-] [76057] Writing DB stats cinder:UPDATE=1 {{(pid=76057) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 17:57:06 devstack cinder-volume[76057]: DEBUG oslo_service.periodic_task [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76057) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 17:57:06 devstack cinder-volume[76057]: DEBUG cinder.volume.drivers.lvm [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Updating volume stats {{(pid=76057) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 07 17:57:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:57:06 devstack sudo[84767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 07 17:57:06 devstack sudo[84767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:57:06 devstack sudo[84767]: pam_unix(sudo:session): session closed for user root
Sep 07 17:57:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:57:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:57:06 devstack sudo[84770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 07 17:57:06 devstack sudo[84770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:57:06 devstack sudo[84770]: pam_unix(sudo:session): session closed for user root
Sep 07 17:57:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:57:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:57:06 devstack sudo[84776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 07 17:57:06 devstack sudo[84776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:57:06 devstack sudo[84776]: pam_unix(sudo:session): session closed for user root
Sep 07 17:57:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:57:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:57:06 devstack sudo[84796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 07 17:57:06 devstack sudo[84796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:57:07 devstack sudo[84796]: pam_unix(sudo:session): session closed for user root
Sep 07 17:57:07 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:57:07 devstack cinder-volume[76057]: DEBUG cinder.manager [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Notifying Schedulers of capabilities ... {{(pid=76057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 17:57:07 devstack cinder-volume[76057]: DEBUG oslo_service.periodic_task [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Running periodic task VolumeManager._thread_info {{(pid=76057) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 17:57:07 devstack cinder-volume[76057]: DEBUG cinder.volume.manager [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] thread count: 6 {{(pid=76057) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 07 17:57:07 devstack cinder-volume[76057]: DEBUG cinder.volume.manager [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] thread info: [<_MainThread(MainThread, started 140531199955072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140531086445568)>, <Thread(Thread-3 (stat_writer), started daemon 140531086302784)>, <Thread(Rabbit-heartbeat, started daemon 140531084968576)>, <Thread(Thread-5 (_runner), started daemon 140531085018560)>, <Thread(Thread-7 (_runner), started daemon 140531085031104)>] {{(pid=76057) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 07 17:58:06 devstack cinder-volume[76057]: DEBUG oslo_service.periodic_task [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76057) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 17:58:06 devstack cinder-volume[76057]: DEBUG cinder.volume.drivers.lvm [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Updating volume stats {{(pid=76057) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 07 17:58:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:58:06 devstack sudo[86069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 07 17:58:06 devstack sudo[86069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:58:06 devstack sudo[86069]: pam_unix(sudo:session): session closed for user root
Sep 07 17:58:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:58:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:58:06 devstack sudo[86072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 07 17:58:06 devstack sudo[86072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:58:06 devstack sudo[86072]: pam_unix(sudo:session): session closed for user root
Sep 07 17:58:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:58:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:58:06 devstack sudo[86075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 07 17:58:06 devstack sudo[86075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:58:06 devstack sudo[86075]: pam_unix(sudo:session): session closed for user root
Sep 07 17:58:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:58:06 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:58:06 devstack sudo[86079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 07 17:58:06 devstack sudo[86079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:58:07 devstack sudo[86079]: pam_unix(sudo:session): session closed for user root
Sep 07 17:58:07 devstack cinder-volume[76057]: DEBUG oslo_concurrency.processutils [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76057) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:58:07 devstack cinder-volume[76057]: DEBUG cinder.manager [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Notifying Schedulers of capabilities ... {{(pid=76057) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 17:58:07 devstack cinder-volume[76057]: DEBUG oslo_service.periodic_task [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] Running periodic task VolumeManager._thread_info {{(pid=76057) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 17:58:07 devstack cinder-volume[76057]: DEBUG cinder.volume.manager [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] thread count: 6 {{(pid=76057) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 07 17:58:07 devstack cinder-volume[76057]: DEBUG cinder.volume.manager [None req-6603a0c0-3c98-45c8-9517-e418a77f333f None None] thread info: [<_MainThread(MainThread, started 140531199955072)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 140531086445568)>, <Thread(Thread-3 (stat_writer), started daemon 140531086302784)>, <Thread(Rabbit-heartbeat, started daemon 140531084968576)>, <Thread(Thread-5 (_runner), started daemon 140531085018560)>, <Thread(Thread-7 (_runner), started daemon 140531085031104)>] {{(pid=76057) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 07 17:58:12 devstack cinder-volume[76057]: DEBUG dbcounter [-] [76057] Writing DB stats cinder:SELECT=1 {{(pid=76057) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 17:58:12 devstack cinder-volume[76057]: DEBUG dbcounter [-] [76057] Writing DB stats cinder:UPDATE=1 {{(pid=76057) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 17:58:18 devstack cinder-volume[75872]: INFO oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Caught SIGTERM, stopping children
Sep 07 17:58:18 devstack cinder-volume[75872]: DEBUG oslo_concurrency.lockutils [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Acquiring lock "singleton_lock" {{(pid=75872) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 07 17:58:18 devstack cinder-volume[75872]: DEBUG oslo_concurrency.lockutils [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Acquired lock "singleton_lock" {{(pid=75872) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 07 17:58:18 devstack cinder-volume[75872]: DEBUG oslo_concurrency.lockutils [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Releasing lock "singleton_lock" {{(pid=75872) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 07 17:58:18 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Stop services. {{(pid=75872) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 07 17:58:18 devstack cinder-volume[75872]: DEBUG oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Killing children. {{(pid=75872) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 07 17:58:18 devstack cinder-volume[75872]: INFO oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Waiting on 1 children to exit
Sep 07 17:58:20 devstack cinder-volume[76057]: DEBUG oslo_concurrency.lockutils [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Acquiring lock "singleton_lock" {{(pid=76057) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 07 17:58:20 devstack cinder-volume[76057]: DEBUG oslo_concurrency.lockutils [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Acquired lock "singleton_lock" {{(pid=76057) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 07 17:58:20 devstack cinder-volume[76057]: DEBUG oslo_concurrency.lockutils [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Releasing lock "singleton_lock" {{(pid=76057) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 07 17:58:20 devstack cinder-volume[76057]: WARNING amqp [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 07 17:58:20 devstack cinder-volume[76057]: WARNING amqp [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 07 17:58:20 devstack cinder-volume[75872]: INFO oslo_service.backend._eventlet.service [None req-be7dc310-a335-490c-ac65-026bbade331a None None] Child 76057 exited with status 0
Sep 07 17:58:21 devstack cinder-volume[86466]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 07 17:58:21 devstack cinder-volume[86466]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 07 17:58:21 devstack cinder-volume[86466]: we strongly recommend against using it for new projects.
Sep 07 17:58:21 devstack cinder-volume[86466]: If you are already using Eventlet, we recommend migrating to a different
Sep 07 17:58:21 devstack cinder-volume[86466]: framework.  For more detail see
Sep 07 17:58:21 devstack cinder-volume[86466]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 07 17:58:21 devstack cinder-volume[86466]:   import eventlet  # noqa
Sep 07 17:58:23 devstack cinder-volume[86466]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86466) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 07 17:58:23 devstack cinder-volume[86466]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86466) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 07 17:58:23 devstack cinder-volume[86466]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86466) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 07 17:58:24 devstack cinder-volume[86466]: INFO dbcounter [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] Registered counter for database cinder
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_db.sqlalchemy.engines [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86466) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG dbcounter [-] [86466] Writer thread running {{(pid=86466) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 07 17:58:24 devstack cinder-volume[86466]: INFO cinder.rpc [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 07 17:58:24 devstack cinder-volume[86466]: INFO cinder.rpc [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_db.sqlalchemy.engines [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86466) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 07 17:58:24 devstack cinder-volume[86466]: INFO cinder.volume.manager [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] Determined volume DB was empty at startup.
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG cinder.volume.manager [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86466) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 07 17:58:24 devstack cinder-volume[86466]: INFO cinder.volume.manager [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 07 17:58:24 devstack cinder-volume[86466]: WARNING stevedore.named [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 07 17:58:24 devstack cinder-volume[86466]: WARNING castellan.key_manager [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 07 17:58:24 devstack cinder-volume[86466]: WARNING cinder.keymgr.conf_key_mgr [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 07 17:58:24 devstack cinder-volume[86466]: INFO cinder.volume.manager [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_db.sqlalchemy.engines [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86466) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 07 17:58:24 devstack cinder-volume[86466]: INFO oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] Starting 1 workers
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] Started child 86688 {{(pid=86466) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] Full set of CONF: {{(pid=86466) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] ******************************************************************************** {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] Configuration options gathered from: {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 07 17:58:24 devstack cinder-volume[86688]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] ================================================================================ {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] allow_availability_zone_fallback = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] allow_compression_on_image_upload = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] allowed_direct_url_schemes     = [] {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] api_rate_limit                 = True {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] auth_strategy                  = keystone {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_availability_zone      = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_host                   = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_name                   = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_stats_polling_interval = 60 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backup_api_class               = cinder.backup.api.API {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backup_name_template           = backup-%s {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backup_use_same_host           = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backup_use_temp_snapshot       = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] chap_password                  = **** {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] chap_username                  =  {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cinder_internal_tenant_project_id = 2fa748cbec7a4142b1ea91f491d6f90f {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cinder_internal_tenant_user_id = 4e661a4618c540b6a4eab4428e257dc3 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cluster                        = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] compression_format             = gzip {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] config_dir                     = [] {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] config_source                  = [] {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] control_exchange               = openstack {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] debug                          = True {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] default_availability_zone      = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] default_group_type             = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] default_volume_type            = QuobyteHD {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] disk_geometry                  = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] driver_client_cert             = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] driver_client_cert_key         = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] driver_data_namespace          = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] driver_ssl_cert_path           = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] driver_ssl_cert_verify         = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] driver_use_ssl                 = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] enable_new_services            = True {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] enable_unsupported_driver      = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] enforce_multipath_for_image_xfer = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] filter_function                = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] glance_api_insecure            = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] glance_api_servers             = ['http://192.168.122.66/image'] {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] glance_api_ssl_compression     = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] glance_ca_certificates_file    = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] glance_certfile                = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] glance_keyfile                 = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] glance_num_retries             = 3 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] glance_request_timeout         = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] goodness_function              = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] graceful_shutdown_timeout      = 5 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] group_api_class                = cinder.group.api.API {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] host                           = devstack {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] image_compress_on_upload       = True {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] image_conversion_address_space_limit = 1 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] image_conversion_cpu_limit     = 60 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] image_conversion_disable       = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] image_upload_use_cinder_backend = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] image_upload_use_internal_tenant = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] image_volume_cache_enabled     = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] image_volume_cache_max_count   = 0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] image_volume_cache_max_size_gb = 0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] init_host_max_objects_retrieval = 0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] iscsi_target_flags             =  {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] iscsi_write_cache              = on {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] iser_helper                    = tgtadm {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 07 17:58:24 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.remotefs [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86688) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] iser_ip_address                = 192.168.122.66 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] iser_port                      = 3260 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] log_color                      = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] log_config_append              = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] log_dir                        = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] log_file                       = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] log_options                    = True {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] log_rotate_interval            = 1 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] log_rotate_interval_type       = days {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] log_rotation_type              = none {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] max_age                        = 0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] max_logfile_count              = 30 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] max_logfile_size_mb            = 200 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] max_over_subscription_ratio    = 20.0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] message_reap_interval          = 86400 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] message_ttl                    = 2592000 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] migration_create_volume_timeout_secs = 300 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] monkey_patch                   = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] monkey_patch_modules           = [] {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] my_ip                          = 192.168.122.66 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] no_snapshot_gb_quota           = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] num_iser_scan_tries            = 3 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] num_shell_tries                = 3 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] num_volume_device_scan_tries   = 3 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] nvmeof_conn_info_version       = 1 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] nvmet_ns_id                    = 10 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] nvmet_port_id                  = 1 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] osapi_max_limit                = 1000 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] osapi_volume_ext_list          = [] {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] osapi_volume_listen_port       = 8776 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] osapi_volume_use_ssl           = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] osapi_volume_workers           = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] per_volume_size_limit          = -1 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] periodic_fuzzy_delay           = 60 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] periodic_interval              = 60 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] public_endpoint                = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] publish_errors                 = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] quota_backup_gigabytes         = 1000 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] quota_backups                  = 10 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] quota_gigabytes                = 1000 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] quota_groups                   = 10 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] quota_snapshots                = 10 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] quota_volumes                  = 10 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] rate_limit_burst               = 0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] rate_limit_except_level        = CRITICAL {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] rate_limit_interval            = 0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] reinit_driver_count            = 3 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] replication_device             = **** {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] report_discard_supported       = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] report_interval                = 120 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] reservation_clean_interval     = 86400 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] reservation_expire             = 86400 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] reserved_image_namespaces      = [] {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] reserved_percentage            = 0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] rpc_response_timeout           = 120 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] run_external_periodic_tasks    = True {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] scst_target_driver             = iscsi {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] scst_target_iqn_name           = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] service_down_time              = 720 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] shell_completion               = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] snapshot_name_template         = snapshot-%s {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] split_loggers                  = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] state_path                     = /opt/stack/data/cinder {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] storage_availability_zone      = nova {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] storage_protocol               = iSCSI {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] syslog_log_facility            = LOG_USER {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] target_helper                  = lioadm {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] target_ip_address              = 192.168.122.66 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] target_port                    = 3260 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] target_protocol                = iscsi {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] target_secondary_ip_addresses  = [] {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] trace_flags                    = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] transport_url                  = **** {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] until_refresh                  = 0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] use_chap_auth                  = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] use_default_quota_class        = True {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] use_journal                    = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] use_json                       = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] use_multipath_for_image_xfer   = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] use_stderr                     = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] use_syslog                     = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] verify_glance_signatures       = enabled {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] volume_api_class               = cinder.volume.api.API {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] volume_backend_name            = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] volume_clear                   = zero {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] volume_clear_ionice            = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] volume_clear_size              = 0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] volume_copy_bps_limit          = 0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] volume_dd_blocksize            = 1M {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] volume_name_template           = volume-%s {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] volume_service_inithost_offload = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] volume_usage_audit_period      = month {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] zoning_mode                    = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_concurrency.disable_process_locking = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:24 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.auth_section = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.auth_type   = password {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.auth_version = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.cache       = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.certfile    = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.include_service_catalog = True {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.insecure    = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.interface   = public {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.keyfile     = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.memcache_password = **** {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86688) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 07 17:58:25 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.quobyte [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 07 17:58:25 devstack cinder-volume[86688]: WARNING cinder.volume.drivers.quobyte [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 07 17:58:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Running cmd (subprocess): mount.quobyte {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.memcache_username = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.region_name = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.service_type = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.66/identity {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.backend                  = dogpile.cache.null {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.backend_argument         = **** {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.backend_expiration_time  = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.config_prefix            = cache.oslo {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.debug_cache_backend      = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.enable_retry_client      = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.enable_socket_keepalive  = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.enabled                  = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.expiration_time          = 600 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.hashclient_retry_attempts = 2 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.memcache_dead_retry      = 300 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.memcache_sasl_enabled    = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.password                 = **** {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.proxies                  = [] {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.redis_db                 = 0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.redis_server             = localhost:6379 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.retry_attempts           = 2 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.retry_delay              = 0.0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.socket_keepalive_count   = 1 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.socket_keepalive_idle    = 1 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.socket_keepalive_interval = 1 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.socket_timeout           = 1.0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.tls_allowed_ciphers      = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.tls_cafile               = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.tls_certfile             = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.tls_enabled              = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.tls_keyfile              = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cache.username                 = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] coordination.backend_url       = **** {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] database.asyncio_connection    = **** {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] database.asyncio_slave_connection = **** {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] database.backend               = sqlalchemy {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] database.connection            = **** {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] database.connection_debug      = 0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] database.connection_parameters =  {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] database.connection_recycle_time = 3600 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] database.connection_trace      = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] database.db_inc_retry_interval = True {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] database.db_max_retries        = 20 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] database.db_max_retry_interval = 10 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] database.db_retry_interval     = 1 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] database.max_overflow          = 50 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] database.max_pool_size         = 5 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] database.max_retries           = 10 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] database.mysql_wsrep_sync_wait = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] database.pool_timeout          = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] database.retry_interval        = 10 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] database.slave_connection      = **** {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] database.sqlite_synchronous    = True {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] database.synchronous_reader    = True {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] database.use_db_reconnect      = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_tracing.insecure = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] profiler.connection_string     = messaging:// {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] profiler.enabled               = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] profiler.es_doc_type           = notification {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] profiler.es_scroll_size        = 10000 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] profiler.es_scroll_time        = 2m {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] profiler.filter_error_trace    = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] profiler.hmac_keys             = **** {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] profiler.sentinel_service_name = mymaster {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] profiler.socket_timeout        = 0.1 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] profiler.trace_requests        = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] profiler.trace_sqlalchemy      = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] profiler_jaeger.process_tags   = {} {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] profiler_jaeger.service_name_prefix = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] profiler_otlp.service_name_prefix = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_policy.enforce_new_defaults = True {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_policy.policy_default_rule = default {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] privsep_osbrick.group          = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack quobyte-client[86691]: Reading configuration file: /etc/quobyte/client.cfg
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] privsep_osbrick.helper_command = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] privsep_osbrick.user           = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack quobyte-client[86691]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cinder_sys_admin.group         = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cinder_sys_admin.helper_command = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] cinder_sys_admin.user          = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] service_user.auth_section      = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] service_user.auth_type         = password {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] service_user.cafile            = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] CMD "mount.quobyte" returned: 1 in 0.110s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] service_user.certfile          = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] service_user.collect_timing    = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] service_user.insecure          = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] service_user.keyfile           = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] service_user.send_service_user_token = True {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] service_user.split_loggers     = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] service_user.timeout           = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] service_user.tls_ciphers       = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] service_user.tls_min_version   = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] glance.auth_section            = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] glance.auth_type               = password {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] glance.certfile                = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] glance.collect_timing          = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] glance.insecure                = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] glance.keyfile                 = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] glance.region_name             = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] glance.split_loggers           = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] glance.timeout                 = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86688]: INFO cinder.volume.drivers.quobyte [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d ...
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] glance.tls_ciphers             = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] glance.tls_min_version         = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.backend_availability_zone = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a -c /etc/quobyte/client-cinder.cfg {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.chap_password = **** {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.chap_username =  {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.disk_geometry = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.driver_client_cert = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.driver_client_cert_key = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.driver_data_namespace = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.driver_use_ssl = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.extra_capabilities = {} {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.filter_function = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.goodness_function = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.iscsi_target_flags =  {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.iscsi_write_cache = on {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.iser_ip_address = 192.168.122.66 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.iser_port     = 3260 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.nas_host      =  {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.nas_login     = admin {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.nas_mount_options = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.nas_password  = **** {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.nas_private_key =  {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.nas_share_path =  {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.num_shell_tries = 3 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.quobyte_volume_url = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.replication_device = **** {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.report_discard_supported = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.reserved_percentage = 0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.target_helper = tgtadm {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.target_ip_address = 192.168.122.66 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.target_port   = 3260 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.target_protocol = iscsi {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.trace_flags   = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.unique_fqdn_network = True {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.use_chap_auth = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.volume_backend_name = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.volume_clear  = zero {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.volume_clear_ionice = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.volume_clear_size = 0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_reports.file_event_handler = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_reports.log_dir           = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.backend_availability_zone = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.backend_host         = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.chap_password        = **** {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.chap_username        = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.disk_geometry        = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.driver_client_cert   = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.driver_data_namespace = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.extra_capabilities   = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.filter_function      = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.goodness_function    = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.iser_helper          = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.iser_ip_address      = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.iser_port            = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.nas_host             = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.nas_login            = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.nas_mount_options    = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.nas_password         = **** {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.nas_private_key      = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.nas_share_path       = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.num_shell_tries      = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack sudo[86695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a -c /etc/quobyte/client-cinder.cfg
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.replication_device   = **** {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.report_discard_supported = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.reserved_percentage  = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.scst_target_driver   = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack sudo[86695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.storage_protocol     = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.target_helper        = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.target_ip_address    = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.target_port          = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.target_prefix        = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.target_protocol      = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.trace_flags          = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.use_chap_auth        = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.volume_clear         = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.volume_clear_size    = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] QuobyteHD.volumes_dir          = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_notifications.driver = [] {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_notifications.retry = -1 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] key_manager.fixed_key          = **** {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican.barbican_api_version  = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican.barbican_endpoint     = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican.barbican_endpoint_type = public {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican.barbican_region_name  = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican.cafile                = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican.certfile              = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican.collect_timing        = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican.insecure              = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican.keyfile               = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican.number_of_retries     = 60 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican.retry_delay           = 1 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican.send_service_user_token = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican.split_loggers         = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican.timeout               = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican.tls_ciphers           = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican.tls_min_version       = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican.verify_ssl            = True {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican.verify_ssl_path       = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican_service_user.auth_section = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican_service_user.auth_type = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican_service_user.cafile   = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican_service_user.certfile = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican_service_user.collect_timing = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican_service_user.insecure = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican_service_user.keyfile  = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican_service_user.split_loggers = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican_service_user.timeout  = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican_service_user.tls_ciphers = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] barbican_service_user.tls_min_version = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] vault.approle_role_id          = **** {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] vault.approle_secret_id        = **** {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] vault.auth_method              = approle {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] vault.auth_path                = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] vault.kv_mountpoint            = secret {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] vault.kv_path                  = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] vault.kv_version               = 2 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] vault.namespace                = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] vault.root_token_id            = **** {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] vault.ssl_ca_crt_file          = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] vault.timeout                  = 60.0 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] vault.token_file               = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] vault.token_role               = None {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] vault.use_ssl                  = False {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:25 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] ******************************************************************************** {{(pid=86466) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 07 17:58:25 devstack sudo[86695]: pam_unix(sudo:session): session closed for user root
Sep 07 17:58:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.457s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:58:25 devstack cinder-volume[86688]: INFO cinder.volume.drivers.quobyte [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d succeeded
Sep 07 17:58:25 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 17:58:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.474s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 17:58:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:58:25 devstack sudo[86764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 17:58:25 devstack sudo[86764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:58:25 devstack sudo[86764]: pam_unix(sudo:session): session closed for user root
Sep 07 17:58:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.232s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:58:25 devstack cinder-volume[86688]: INFO cinder.volume.driver [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Driver hasn't implemented _init_vendor_properties()
Sep 07 17:58:25 devstack cinder-volume[86688]: DEBUG cinder.volume.driver [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5530242919922, 'free_capacity_gb': 1773.5530242919922, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86688) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 07 17:58:25 devstack cinder-volume[86688]: DEBUG oslo_db.sqlalchemy.engines [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86688) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 07 17:58:25 devstack cinder-volume[86688]: DEBUG dbcounter [-] [86688] Writer thread running {{(pid=86688) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 07 17:58:25 devstack cinder-volume[86688]: DEBUG cinder.db.api [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Building query based on filter {{(pid=86688) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 07 17:58:25 devstack cinder-volume[86688]: DEBUG cinder.image.image_utils [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86688) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Sep 07 17:58:25 devstack cinder-volume[86688]: INFO cinder.keymgr.migration [None req-7a7601a0-2849-499c-a8cb-d7a97818de65 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 07 17:58:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 17:58:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 17:58:25 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 17:58:25 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 17:58:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 17:58:25 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:58:26 devstack sudo[86767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 17:58:26 devstack sudo[86767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:58:26 devstack sudo[86767]: pam_unix(sudo:session): session closed for user root
Sep 07 17:58:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.255s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:58:26 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 17:58:26 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Driver initialization completed successfully.
Sep 07 17:58:26 devstack cinder-volume[86688]: INFO cinder.manager [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Initiating service 3 cleanup
Sep 07 17:58:26 devstack cinder-volume[86688]: INFO cinder.manager [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Service 3 cleanup completed.
Sep 07 17:58:26 devstack cinder-volume[86688]: DEBUG cinder.service [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Creating RPC server for service cinder-volume {{(pid=86688) start /opt/stack/cinder/cinder/service.py:231}}
Sep 07 17:58:26 devstack cinder-volume[86688]: DEBUG cinder.service [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86688) start /opt/stack/cinder/cinder/service.py:237}}
Sep 07 17:58:26 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 07 17:58:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 17:58:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 17:58:26 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 17:58:26 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 17:58:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 17:58:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:58:26 devstack sudo[86796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 17:58:26 devstack sudo[86796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:58:26 devstack sudo[86796]: pam_unix(sudo:session): session closed for user root
Sep 07 17:58:26 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.368s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:58:26 devstack cinder-volume[86688]: INFO cinder.volume.manager [None req-9eaecf4b-cfad-4c49-b474-29262e33c51c None None] Driver post RPC initialization completed successfully.
Sep 07 17:58:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-223d1b99-9d94-4ad4-9d96-35bb62424105 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 17:58:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-223d1b99-9d94-4ad4-9d96-35bb62424105 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 17:58:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-223d1b99-9d94-4ad4-9d96-35bb62424105 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=86688) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 17:58:30 devstack cinder-volume[86688]: DEBUG cinder.volume.drivers.quobyte [None req-223d1b99-9d94-4ad4-9d96-35bb62424105 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=86688) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 17:58:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-223d1b99-9d94-4ad4-9d96-35bb62424105 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86688) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 17:58:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-223d1b99-9d94-4ad4-9d96-35bb62424105 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:58:30 devstack sudo[86892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 17:58:30 devstack sudo[86892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:58:30 devstack sudo[86892]: pam_unix(sudo:session): session closed for user root
Sep 07 17:58:30 devstack cinder-volume[86688]: DEBUG oslo_concurrency.processutils [None req-223d1b99-9d94-4ad4-9d96-35bb62424105 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.251s {{(pid=86688) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:58:30 devstack cinder-volume[86688]: DEBUG cinder.manager [None req-223d1b99-9d94-4ad4-9d96-35bb62424105 None None] Notifying Schedulers of capabilities ... {{(pid=86688) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 17:58:31 devstack cinder-volume[86466]: INFO oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] Caught SIGTERM, stopping children
Sep 07 17:58:31 devstack cinder-volume[86466]: DEBUG oslo_concurrency.lockutils [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] Acquiring lock "singleton_lock" {{(pid=86466) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 07 17:58:31 devstack cinder-volume[86466]: DEBUG oslo_concurrency.lockutils [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] Acquired lock "singleton_lock" {{(pid=86466) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 07 17:58:31 devstack cinder-volume[86466]: DEBUG oslo_concurrency.lockutils [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] Releasing lock "singleton_lock" {{(pid=86466) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 07 17:58:31 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] Stop services. {{(pid=86466) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 07 17:58:31 devstack cinder-volume[86466]: DEBUG oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] Killing children. {{(pid=86466) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 07 17:58:31 devstack cinder-volume[86466]: INFO oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] Waiting on 1 children to exit
Sep 07 17:58:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] Acquiring lock "singleton_lock" {{(pid=86688) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 07 17:58:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] Acquired lock "singleton_lock" {{(pid=86688) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 07 17:58:34 devstack cinder-volume[86688]: DEBUG oslo_concurrency.lockutils [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] Releasing lock "singleton_lock" {{(pid=86688) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 07 17:58:34 devstack cinder-volume[86688]: WARNING amqp [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 07 17:58:34 devstack cinder-volume[86688]: WARNING amqp [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 07 17:58:34 devstack cinder-volume[86466]: INFO oslo_service.backend._eventlet.service [None req-d00deca4-2d12-413f-acca-89f3226eb430 None None] Child 86688 exited with status 0
Sep 07 17:58:35 devstack cinder-volume[86969]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 07 17:58:35 devstack cinder-volume[86969]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 07 17:58:35 devstack cinder-volume[86969]: we strongly recommend against using it for new projects.
Sep 07 17:58:35 devstack cinder-volume[86969]: If you are already using Eventlet, we recommend migrating to a different
Sep 07 17:58:35 devstack cinder-volume[86969]: framework.  For more detail see
Sep 07 17:58:35 devstack cinder-volume[86969]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 07 17:58:35 devstack cinder-volume[86969]:   import eventlet  # noqa
Sep 07 17:58:38 devstack cinder-volume[86969]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86969) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 07 17:58:38 devstack cinder-volume[86969]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86969) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 07 17:58:38 devstack cinder-volume[86969]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86969) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 07 17:58:38 devstack cinder-volume[86969]: INFO dbcounter [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] Registered counter for database cinder
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_db.sqlalchemy.engines [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86969) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG dbcounter [-] [86969] Writer thread running {{(pid=86969) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 07 17:58:39 devstack cinder-volume[86969]: INFO cinder.rpc [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 07 17:58:39 devstack cinder-volume[86969]: INFO cinder.rpc [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_db.sqlalchemy.engines [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86969) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 07 17:58:39 devstack cinder-volume[86969]: INFO cinder.volume.manager [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] Determined volume DB was empty at startup.
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG cinder.volume.manager [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86969) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 07 17:58:39 devstack cinder-volume[86969]: WARNING stevedore.named [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 07 17:58:39 devstack cinder-volume[86969]: WARNING castellan.key_manager [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 07 17:58:39 devstack cinder-volume[86969]: WARNING cinder.keymgr.conf_key_mgr [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 07 17:58:39 devstack cinder-volume[86969]: INFO cinder.volume.manager [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_db.sqlalchemy.engines [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86969) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 07 17:58:39 devstack cinder-volume[86969]: INFO oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] Starting 1 workers
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] Started child 87269 {{(pid=86969) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] Full set of CONF: {{(pid=86969) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] ******************************************************************************** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] Configuration options gathered from: {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] ================================================================================ {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] allow_availability_zone_fallback = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[87269]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] allow_compression_on_image_upload = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] allowed_direct_url_schemes     = [] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] api_rate_limit                 = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] auth_strategy                  = keystone {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_availability_zone      = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_host                   = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_name                   = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_stats_polling_interval = 60 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backup_api_class               = cinder.backup.api.API {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backup_name_template           = backup-%s {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backup_use_same_host           = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backup_use_temp_snapshot       = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] chap_password                  = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] chap_username                  =  {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cinder_internal_tenant_project_id = 2fa748cbec7a4142b1ea91f491d6f90f {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cinder_internal_tenant_user_id = 4e661a4618c540b6a4eab4428e257dc3 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cluster                        = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] compression_format             = gzip {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] config_dir                     = [] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] config_source                  = [] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] control_exchange               = openstack {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] debug                          = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] default_availability_zone      = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] default_group_type             = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] default_volume_type            = QuobyteHD {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] disk_geometry                  = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] driver_client_cert             = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] driver_client_cert_key         = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] driver_data_namespace          = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] driver_ssl_cert_path           = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] driver_ssl_cert_verify         = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] driver_use_ssl                 = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] enable_new_services            = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] enable_unsupported_driver      = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] enforce_multipath_for_image_xfer = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] filter_function                = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] glance_api_insecure            = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] glance_api_servers             = ['http://192.168.122.66/image'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] glance_api_ssl_compression     = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] glance_ca_certificates_file    = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] glance_certfile                = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] glance_keyfile                 = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] glance_num_retries             = 3 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] glance_request_timeout         = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] goodness_function              = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] graceful_shutdown_timeout      = 5 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] group_api_class                = cinder.group.api.API {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] host                           = devstack {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] image_compress_on_upload       = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] image_conversion_address_space_limit = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] image_conversion_cpu_limit     = 60 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] image_conversion_disable       = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] image_upload_use_cinder_backend = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] image_upload_use_internal_tenant = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] image_volume_cache_enabled     = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] image_volume_cache_max_count   = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] image_volume_cache_max_size_gb = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] init_host_max_objects_retrieval = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] iscsi_target_flags             =  {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] iscsi_write_cache              = on {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] iser_helper                    = tgtadm {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] iser_ip_address                = 192.168.122.66 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] iser_port                      = 3260 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] log_color                      = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] log_config_append              = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] log_dir                        = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] log_file                       = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] log_options                    = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] log_rotate_interval            = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] log_rotate_interval_type       = days {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] log_rotation_type              = none {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] max_age                        = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] max_logfile_count              = 30 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] max_logfile_size_mb            = 200 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] max_over_subscription_ratio    = 20.0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] message_reap_interval          = 86400 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] message_ttl                    = 2592000 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] migration_create_volume_timeout_secs = 300 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] monkey_patch                   = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] monkey_patch_modules           = [] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] my_ip                          = 192.168.122.66 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] no_snapshot_gb_quota           = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] num_iser_scan_tries            = 3 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] num_shell_tries                = 3 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] num_volume_device_scan_tries   = 3 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] nvmeof_conn_info_version       = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] nvmet_ns_id                    = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] nvmet_port_id                  = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] osapi_max_limit                = 1000 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] osapi_volume_ext_list          = [] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] osapi_volume_listen_port       = 8776 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] osapi_volume_use_ssl           = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] osapi_volume_workers           = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] per_volume_size_limit          = -1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] periodic_fuzzy_delay           = 60 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] periodic_interval              = 60 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] public_endpoint                = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] publish_errors                 = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] quota_backup_gigabytes         = 1000 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] quota_backups                  = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] quota_gigabytes                = 1000 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] quota_groups                   = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] quota_snapshots                = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] quota_volumes                  = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] rate_limit_burst               = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] rate_limit_except_level        = CRITICAL {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] rate_limit_interval            = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] reinit_driver_count            = 3 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] replication_device             = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] report_discard_supported       = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] report_interval                = 120 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87269) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] reservation_clean_interval     = 86400 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] reservation_expire             = 86400 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] reserved_image_namespaces      = [] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] reserved_percentage            = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] rpc_response_timeout           = 120 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] run_external_periodic_tasks    = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] scst_target_driver             = iscsi {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] scst_target_iqn_name           = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] service_down_time              = 720 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] shell_completion               = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] snapshot_name_template         = snapshot-%s {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] split_loggers                  = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] state_path                     = /opt/stack/data/cinder {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] storage_availability_zone      = nova {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] storage_protocol               = iSCSI {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] syslog_log_facility            = LOG_USER {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] target_helper                  = lioadm {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] target_ip_address              = 192.168.122.66 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] target_port                    = 3260 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] target_protocol                = iscsi {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] target_secondary_ip_addresses  = [] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] trace_flags                    = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] transport_url                  = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] until_refresh                  = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] use_chap_auth                  = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] use_default_quota_class        = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] use_journal                    = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] use_json                       = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] use_multipath_for_image_xfer   = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] use_stderr                     = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] use_syslog                     = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] verify_glance_signatures       = enabled {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] volume_api_class               = cinder.volume.api.API {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] volume_backend_name            = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] volume_clear                   = zero {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] volume_clear_ionice            = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] volume_clear_size              = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] volume_copy_bps_limit          = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] volume_dd_blocksize            = 1M {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] volume_name_template           = volume-%s {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] volume_service_inithost_offload = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] volume_usage_audit_period      = month {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] zoning_mode                    = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_concurrency.disable_process_locking = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.auth_section = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.auth_type   = password {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.auth_version = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.cache       = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.certfile    = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.include_service_catalog = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.insecure    = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.interface   = public {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.keyfile     = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.memcache_password = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.memcache_username = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.region_name = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.service_type = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.66/identity {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.backend                  = dogpile.cache.null {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.backend_argument         = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.backend_expiration_time  = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.config_prefix            = cache.oslo {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.debug_cache_backend      = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.enable_retry_client      = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.enable_socket_keepalive  = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.enabled                  = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.expiration_time          = 600 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.hashclient_retry_attempts = 2 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.memcache_dead_retry      = 300 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.memcache_sasl_enabled    = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.password                 = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.proxies                  = [] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.redis_db                 = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.redis_server             = localhost:6379 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.retry_attempts           = 2 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.retry_delay              = 0.0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.socket_keepalive_count   = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.socket_keepalive_idle    = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.socket_keepalive_interval = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.socket_timeout           = 1.0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.tls_allowed_ciphers      = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.tls_cafile               = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.tls_certfile             = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.tls_enabled              = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.tls_keyfile              = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cache.username                 = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] coordination.backend_url       = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] database.asyncio_connection    = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] database.asyncio_slave_connection = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] database.backend               = sqlalchemy {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] database.connection            = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] database.connection_debug      = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] database.connection_parameters =  {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] database.connection_recycle_time = 3600 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] database.connection_trace      = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] database.db_inc_retry_interval = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] database.db_max_retries        = 20 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] database.db_max_retry_interval = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] database.db_retry_interval     = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] database.max_overflow          = 50 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] database.max_pool_size         = 5 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] database.max_retries           = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] database.mysql_wsrep_sync_wait = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] database.pool_timeout          = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] database.retry_interval        = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] database.slave_connection      = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] database.sqlite_synchronous    = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] database.synchronous_reader    = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] database.use_db_reconnect      = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_tracing.insecure = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] profiler.connection_string     = messaging:// {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] profiler.enabled               = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] profiler.es_doc_type           = notification {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] profiler.es_scroll_size        = 10000 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] profiler.es_scroll_time        = 2m {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] profiler.filter_error_trace    = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] profiler.hmac_keys             = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] profiler.sentinel_service_name = mymaster {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] profiler.socket_timeout        = 0.1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] profiler.trace_requests        = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] profiler.trace_sqlalchemy      = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] profiler_jaeger.process_tags   = {} {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87269) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 07 17:58:39 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.quobyte [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 07 17:58:39 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.quobyte [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] profiler_jaeger.service_name_prefix = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] profiler_otlp.service_name_prefix = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_policy.enforce_new_defaults = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_policy.policy_default_rule = default {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Running cmd (subprocess): mount.quobyte {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] privsep_osbrick.group          = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] privsep_osbrick.helper_command = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] privsep_osbrick.user           = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cinder_sys_admin.group         = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cinder_sys_admin.helper_command = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] cinder_sys_admin.user          = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] service_user.auth_section      = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] service_user.auth_type         = password {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] service_user.cafile            = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] service_user.certfile          = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] service_user.collect_timing    = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] service_user.insecure          = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] service_user.keyfile           = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] service_user.send_service_user_token = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] service_user.split_loggers     = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] service_user.timeout           = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] service_user.tls_ciphers       = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] service_user.tls_min_version   = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] glance.auth_section            = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] glance.auth_type               = password {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] glance.certfile                = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] glance.collect_timing          = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] glance.insecure                = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] glance.keyfile                 = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] glance.region_name             = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] glance.split_loggers           = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] glance.timeout                 = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] glance.tls_ciphers             = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] glance.tls_min_version         = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.backend_availability_zone = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.chap_password = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.chap_username =  {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.disk_geometry = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.driver_client_cert = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.driver_client_cert_key = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.driver_data_namespace = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.driver_use_ssl = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.extra_capabilities = {} {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.filter_function = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.goodness_function = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.iscsi_target_flags =  {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.iscsi_write_cache = on {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.iser_ip_address = 192.168.122.66 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.iser_port     = 3260 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.nas_host      =  {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.nas_login     = admin {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.nas_mount_options = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.nas_password  = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.nas_private_key =  {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.nas_share_path =  {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.num_shell_tries = 3 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.quobyte_volume_url = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.replication_device = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.report_discard_supported = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.reserved_percentage = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.target_helper = tgtadm {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.target_ip_address = 192.168.122.66 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.target_port   = 3260 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.target_protocol = iscsi {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.trace_flags   = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.unique_fqdn_network = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.use_chap_auth = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.volume_backend_name = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.volume_clear  = zero {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.volume_clear_ionice = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.volume_clear_size = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_reports.file_event_handler = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_reports.log_dir           = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.backend_availability_zone = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.backend_host         = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.chap_password        = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.chap_username        = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.disk_geometry        = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.driver_client_cert   = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.driver_data_namespace = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.extra_capabilities   = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.filter_function      = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.goodness_function    = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.iser_helper          = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.iser_ip_address      = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.iser_port            = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.nas_host             = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.nas_login            = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.nas_mount_options    = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.nas_password         = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.nas_private_key      = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.nas_share_path       = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.num_shell_tries      = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack quobyte-client[87270]: Reading configuration file: /etc/quobyte/client.cfg
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack quobyte-client[87270]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.replication_device   = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.report_discard_supported = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.reserved_percentage  = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.scst_target_driver   = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] CMD "mount.quobyte" returned: 1 in 0.065s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.storage_protocol     = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.target_helper        = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.target_ip_address    = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.target_port          = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.target_prefix        = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.target_protocol      = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.trace_flags          = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.use_chap_auth        = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.volume_clear         = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.volume_clear_size    = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] QuobyteHD.volumes_dir          = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_notifications.driver = [] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_notifications.retry = -1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] key_manager.fixed_key          = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican.barbican_api_version  = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican.barbican_endpoint     = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican.barbican_endpoint_type = public {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican.barbican_region_name  = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican.cafile                = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican.certfile              = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican.collect_timing        = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican.insecure              = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican.keyfile               = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican.number_of_retries     = 60 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican.retry_delay           = 1 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican.send_service_user_token = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican.split_loggers         = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican.timeout               = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican.tls_ciphers           = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican.tls_min_version       = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican.verify_ssl            = True {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican.verify_ssl_path       = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican_service_user.auth_section = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican_service_user.auth_type = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican_service_user.cafile   = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican_service_user.certfile = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican_service_user.collect_timing = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican_service_user.insecure = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack sudo[87271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican_service_user.keyfile  = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican_service_user.split_loggers = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican_service_user.timeout  = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack sudo[87271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican_service_user.tls_ciphers = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] barbican_service_user.tls_min_version = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] vault.approle_role_id          = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] vault.approle_secret_id        = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] vault.auth_method              = approle {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] vault.auth_path                = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] vault.kv_mountpoint            = secret {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] vault.kv_path                  = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] vault.kv_version               = 2 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] vault.namespace                = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] vault.root_token_id            = **** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] vault.ssl_ca_crt_file          = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] vault.timeout                  = 60.0 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] vault.token_file               = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] vault.token_role               = None {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] vault.use_ssl                  = False {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 07 17:58:39 devstack cinder-volume[86969]: DEBUG oslo_service.backend._eventlet.service [None req-ffaf38d7-1bc4-4e53-b40b-21a4fd9a0491 None None] ******************************************************************************** {{(pid=86969) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 07 17:58:40 devstack sudo[87271]: pam_unix(sudo:session): session closed for user root
Sep 07 17:58:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.230s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:58:40 devstack cinder-volume[87269]: INFO cinder.volume.driver [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Driver hasn't implemented _init_vendor_properties()
Sep 07 17:58:40 devstack cinder-volume[87269]: DEBUG cinder.volume.driver [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5530242919922, 'free_capacity_gb': 1773.5530242919922, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87269) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 07 17:58:40 devstack cinder-volume[87269]: DEBUG oslo_db.sqlalchemy.engines [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87269) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 07 17:58:40 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writer thread running {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 07 17:58:40 devstack cinder-volume[87269]: DEBUG cinder.db.api [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Building query based on filter {{(pid=87269) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 07 17:58:40 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87269) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Sep 07 17:58:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 17:58:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 17:58:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 17:58:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 17:58:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 17:58:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:58:40 devstack cinder-volume[87269]: INFO cinder.keymgr.migration [None req-62dfbf1b-61d6-4e32-8542-669208b173f9 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 07 17:58:40 devstack sudo[87282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 17:58:40 devstack sudo[87282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:58:40 devstack sudo[87282]: pam_unix(sudo:session): session closed for user root
Sep 07 17:58:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.229s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:58:40 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 17:58:40 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Driver initialization completed successfully.
Sep 07 17:58:40 devstack cinder-volume[87269]: INFO cinder.manager [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Initiating service 3 cleanup
Sep 07 17:58:40 devstack cinder-volume[87269]: INFO cinder.manager [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Service 3 cleanup completed.
Sep 07 17:58:40 devstack cinder-volume[87269]: DEBUG cinder.service [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Creating RPC server for service cinder-volume {{(pid=87269) start /opt/stack/cinder/cinder/service.py:231}}
Sep 07 17:58:40 devstack cinder-volume[87269]: DEBUG cinder.service [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87269) start /opt/stack/cinder/cinder/service.py:237}}
Sep 07 17:58:40 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 07 17:58:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 17:58:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 17:58:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 17:58:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 17:58:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 17:58:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:58:40 devstack sudo[87293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 17:58:40 devstack sudo[87293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:58:40 devstack sudo[87293]: pam_unix(sudo:session): session closed for user root
Sep 07 17:58:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.229s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:58:40 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a9b633bc-d28d-46d9-82bc-5941ed365bd2 None None] Driver post RPC initialization completed successfully.
Sep 07 17:58:49 devstack cinder-volume[86969]: DEBUG dbcounter [-] [86969] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86969) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 17:58:50 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 17:58:50 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=2 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 17:59:00 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 17:59:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread count: 6 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 07 17:59:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread info: [<_MainThread(MainThread, started 137533762306176)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137533650971072)>, <Thread(Thread-3 (stat_writer), started daemon 137533647226880)>, <Thread(Rabbit-heartbeat, started daemon 137533647437120)>, <Thread(Thread-5 (_runner), started daemon 137533648120896)>, <Thread(Thread-7 (_runner), started daemon 137533648182592)>] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 07 17:59:38 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4d9fd239-6718-48aa-89fa-11f9a65d1285 tempest-GroupSnapshotsTest-319184014 None] Group tempest-GroupSnapshotsTest-Group-1427584054: creating
Sep 07 17:59:38 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4d9fd239-6718-48aa-89fa-11f9a65d1285 tempest-GroupSnapshotsTest-319184014 None] Group tempest-GroupSnapshotsTest-Group-1427584054: created successfully
Sep 07 17:59:38 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4d9fd239-6718-48aa-89fa-11f9a65d1285 tempest-GroupSnapshotsTest-319184014 None] Create group completed successfully.
Sep 07 17:59:39 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 17:59:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Flow 'volume_create_manager' (a39c55a9-e8b7-49d3-9ba9-67a80c4880a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 17:59:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82608310-d7a7-4eba-bac7-7df36f658919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 17:59:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82608310-d7a7-4eba-bac7-7df36f658919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T15:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-353730972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8176ebdb-0f79-4f7a-8518-10fb8e402c9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5203f6f918db430da01b90462fbd15d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:59:39Z,use_quota=True,user_id='8158f47d85fb446392ac64c8e8d89d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 17:59:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68cae1b-9117-4893-9232-57aacb9f323f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 17:59:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68cae1b-9117-4893-9232-57aacb9f323f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 17:59:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c177f32-4dee-4dc9-a42b-6489572b6170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 17:59:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c177f32-4dee-4dc9-a42b-6489572b6170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8176ebdb-0f79-4f7a-8518-10fb8e402c9b', 'volume_name': 'volume-8176ebdb-0f79-4f7a-8518-10fb8e402c9b', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 17:59:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bcc0d6d-66fc-4dc5-b579-cf584d9452cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 17:59:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bcc0d6d-66fc-4dc5-b579-cf584d9452cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 17:59:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24d0417-8e26-420f-a08c-15d346d95be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 17:59:39 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Volume 8176ebdb-0f79-4f7a-8518-10fb8e402c9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8176ebdb-0f79-4f7a-8518-10fb8e402c9b', 'volume_size': 1}
Sep 07 17:59:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 17:59:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 17:59:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T15:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-353730972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8176ebdb-0f79-4f7a-8518-10fb8e402c9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5203f6f918db430da01b90462fbd15d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:59:39Z,use_quota=True,user_id='8158f47d85fb446392ac64c8e8d89d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 17:59:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Creating volume 8176ebdb-0f79-4f7a-8518-10fb8e402c9b {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 17:59:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 17:59:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 17:59:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 17:59:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 17:59:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 17:59:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 17:59:39 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 17:59:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8176ebdb-0f79-4f7a-8518-10fb8e402c9b 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:59:39 devstack sudo[87869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8176ebdb-0f79-4f7a-8518-10fb8e402c9b 1073741824
Sep 07 17:59:39 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:59:40 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root
Sep 07 17:59:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8176ebdb-0f79-4f7a-8518-10fb8e402c9b 1073741824" returned: 0 in 0.953s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:59:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8176ebdb-0f79-4f7a-8518-10fb8e402c9b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:59:40 devstack sudo[88188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8176ebdb-0f79-4f7a-8518-10fb8e402c9b
Sep 07 17:59:40 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:59:40 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root
Sep 07 17:59:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8176ebdb-0f79-4f7a-8518-10fb8e402c9b" returned: 0 in 0.514s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:59:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 17:59:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 17:59:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24d0417-8e26-420f-a08c-15d346d95be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8176ebdb-0f79-4f7a-8518-10fb8e402c9b', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 17:59:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1862ea47-98a9-4d3e-a2c0-a8c4e5b8df61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 17:59:41 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Volume volume-8176ebdb-0f79-4f7a-8518-10fb8e402c9b (8176ebdb-0f79-4f7a-8518-10fb8e402c9b): created successfully
Sep 07 17:59:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1862ea47-98a9-4d3e-a2c0-a8c4e5b8df61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 17:59:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Flow 'volume_create_manager' (a39c55a9-e8b7-49d3-9ba9-67a80c4880a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 17:59:41 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-c58894db-f8d2-4351-8383-1c475f52040c tempest-DeleteServersTestJSON-1580364880 None] Created volume successfully.
Sep 07 17:59:41 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 17:59:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Flow 'volume_create_manager' (35a394e7-3d06-4c00-b360-d31f2a9fbfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 17:59:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcec786a-593f-4523-8bae-5f723cae2c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 17:59:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcec786a-593f-4523-8bae-5f723cae2c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T15:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-271146717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cba4b740-41cc-461b-8add-c10b8df6ad18,host='devstack@QuobyteHD#QuobyteHD',id=ca090d23-9f2e-4c55-ade4-d6d394cb90fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e587b279cef4d6d8329519aa853c0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:59:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:59:41Z,use_quota=True,user_id='55884fccbae9432aa03f85e4eed4ca39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05902c8b-b3cc-433c-bc45-3dfabba0abe9),volume_type_id=05902c8b-b3cc-433c-bc45-3dfabba0abe9)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 17:59:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a997882-b2ce-4e96-bcea-be09e6f9a8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 17:59:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a997882-b2ce-4e96-bcea-be09e6f9a8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 17:59:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4944309d-7da3-49c6-8063-45b2d55bac56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 17:59:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4944309d-7da3-49c6-8063-45b2d55bac56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca090d23-9f2e-4c55-ade4-d6d394cb90fe', 'volume_name': 'volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 17:59:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8885c66e-dc29-40e2-9592-b53199649327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 17:59:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8885c66e-dc29-40e2-9592-b53199649327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 17:59:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d23de63-29ae-49d8-8c08-2505ac17ca0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 17:59:41 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Volume ca090d23-9f2e-4c55-ade4-d6d394cb90fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe', 'volume_size': 1}
Sep 07 17:59:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 17:59:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 17:59:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=cba4b740-41cc-461b-8add-c10b8df6ad18,created_at=2026-09-07T15:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-271146717',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=cba4b740-41cc-461b-8add-c10b8df6ad18,host='devstack@QuobyteHD#QuobyteHD',id=ca090d23-9f2e-4c55-ade4-d6d394cb90fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e587b279cef4d6d8329519aa853c0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:59:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:59:41Z,use_quota=True,user_id='55884fccbae9432aa03f85e4eed4ca39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05902c8b-b3cc-433c-bc45-3dfabba0abe9),volume_type_id=05902c8b-b3cc-433c-bc45-3dfabba0abe9)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 17:59:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Creating volume ca090d23-9f2e-4c55-ade4-d6d394cb90fe {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 17:59:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 17:59:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 17:59:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 17:59:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 17:59:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 17:59:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 17:59:41 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 17:59:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:59:41 devstack sudo[88192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe 1073741824
Sep 07 17:59:41 devstack sudo[88192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:59:41 devstack sudo[88192]: pam_unix(sudo:session): session closed for user root
Sep 07 17:59:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe 1073741824" returned: 0 in 0.686s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:59:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:59:42 devstack sudo[88202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe
Sep 07 17:59:42 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:59:42 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root
Sep 07 17:59:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe" returned: 0 in 0.790s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:59:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 17:59:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 17:59:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d23de63-29ae-49d8-8c08-2505ac17ca0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 17:59:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc73afe8-5368-4b1c-bf2c-b1199fc33821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 17:59:42 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Volume volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe (ca090d23-9f2e-4c55-ade4-d6d394cb90fe): created successfully
Sep 07 17:59:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc73afe8-5368-4b1c-bf2c-b1199fc33821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 17:59:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Flow 'volume_create_manager' (35a394e7-3d06-4c00-b360-d31f2a9fbfda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 17:59:43 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-857b718e-7a2a-4655-a5dc-f9a00dfc1525 tempest-GroupSnapshotsTest-319184014 None] Created volume successfully.
Sep 07 17:59:45 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5da44b63-8a3f-479a-b628-f75d97123635 tempest-GroupSnapshotsTest-319184014 None] GroupSnapshot 5dbd2dfe-78bc-43f6-a64e-c33d23f89c59: creating.
Sep 07 17:59:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5da44b63-8a3f-479a-b628-f75d97123635 tempest-GroupSnapshotsTest-319184014 None] Group snapshot 5dbd2dfe-78bc-43f6-a64e-c33d23f89c59: creating. {{(pid=87269) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 07 17:59:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5da44b63-8a3f-479a-b628-f75d97123635 tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 17:59:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5da44b63-8a3f-479a-b628-f75d97123635 tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 17:59:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-5da44b63-8a3f-479a-b628-f75d97123635 tempest-GroupSnapshotsTest-319184014 None] Creating offline snapshot 0497d97a-c36e-4f4d-bfaa-8887ae02e723 of volume ca090d23-9f2e-4c55-ade4-d6d394cb90fe {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 17:59:45 devstack cinder-volume[87269]: INFO oslo.privsep.daemon [None req-5da44b63-8a3f-479a-b628-f75d97123635 tempest-GroupSnapshotsTest-319184014 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4t7j4nls/privsep.sock']
Sep 07 17:59:45 devstack sudo[88347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4t7j4nls/privsep.sock
Sep 07 17:59:45 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:59:46 devstack cinder-volume[87269]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Sep 07 17:59:46 devstack cinder-volume[87269]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 07 17:59:46 devstack cinder-volume[87269]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Sep 07 17:59:46 devstack cinder-volume[87269]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 07 17:59:46 devstack cinder-volume[87269]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Sep 07 17:59:46 devstack cinder-volume[87269]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Sep 07 17:59:46 devstack cinder-volume[87269]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 07 17:59:46 devstack cinder-volume[87269]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 07 17:59:46 devstack cinder-volume[87269]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Sep 07 17:59:47 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root
Sep 07 17:59:47 devstack cinder-volume[87269]: INFO oslo.privsep.daemon [None req-5da44b63-8a3f-479a-b628-f75d97123635 tempest-GroupSnapshotsTest-319184014 None] Spawned new privsep daemon via rootwrap
Sep 07 17:59:47 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [None req-5da44b63-8a3f-479a-b628-f75d97123635 tempest-GroupSnapshotsTest-319184014 None] Accepted privsep connection to /tmp/tmp4t7j4nls/privsep.sock {{(pid=87269) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Sep 07 17:59:47 devstack cinder-volume[87269]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 07 17:59:47 devstack cinder-volume[87269]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 07 17:59:47 devstack cinder-volume[87269]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 07 17:59:47 devstack cinder-volume[87269]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88355
Sep 07 17:59:47 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e037cbe-5973-43bf-bc97-fe3dfade7ae4]: (2,) {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 17:59:47 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b3ea3d-dae6-4166-ac22-66d39b56176d]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 17:59:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5da44b63-8a3f-479a-b628-f75d97123635 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:59:47 devstack cinder-volume[87269]: WARNING py.warnings [req-a4cfbb0c-6dc9-4a6f-a227-6c961c6f5d9e req-0e9d3309-b326-4ed5-9e83-469c0d602926 tempest-DeleteServersTestJSON-1580364880 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Sep 07 17:59:47 devstack cinder-volume[87269]:   .first()
Sep 07 17:59:47 devstack cinder-volume[87269]: 
Sep 07 17:59:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-a4cfbb0c-6dc9-4a6f-a227-6c961c6f5d9e req-0e9d3309-b326-4ed5-9e83-469c0d602926 tempest-DeleteServersTestJSON-1580364880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 17:59:47 devstack sudo[88369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe
Sep 07 17:59:47 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:59:47 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 17:59:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Flow 'volume_create_manager' (1fd5f5ff-07ba-42c4-a18c-cd8c0315778a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 17:59:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc03be0-5ef8-4ad8-adea-4b9b6ee31e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 17:59:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efc03be0-5ef8-4ad8-adea-4b9b6ee31e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T15:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-714649669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca621e5-904e-4e5b-838d-b5705e4ece73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dccc151571794b928c60bffe89fb6767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:59:48Z,use_quota=True,user_id='85947174acd14c5688f5e1c02616cba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 17:59:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (534e012e-41ab-4071-ae33-bd31a574bf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 17:59:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (534e012e-41ab-4071-ae33-bd31a574bf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 17:59:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d79ef2c0-3f31-4db3-873b-3a168925a0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 17:59:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d79ef2c0-3f31-4db3-873b-3a168925a0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cca621e5-904e-4e5b-838d-b5705e4ece73', 'volume_name': 'volume-cca621e5-904e-4e5b-838d-b5705e4ece73', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 17:59:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a82347-ded6-48b0-9c9a-952c8283197d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 17:59:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a82347-ded6-48b0-9c9a-952c8283197d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 17:59:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a872d3-5996-4e87-85e0-dfda407b2e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 17:59:47 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Volume cca621e5-904e-4e5b-838d-b5705e4ece73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cca621e5-904e-4e5b-838d-b5705e4ece73', 'volume_size': 1}
Sep 07 17:59:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 17:59:48 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root
Sep 07 17:59:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5da44b63-8a3f-479a-b628-f75d97123635 tempest-GroupSnapshotsTest-319184014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe" returned: 0 in 0.580s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:59:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5da44b63-8a3f-479a-b628-f75d97123635 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.0497d97a-c36e-4f4d-bfaa-8887ae02e723 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:59:48 devstack sudo[88375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.0497d97a-c36e-4f4d-bfaa-8887ae02e723 1G
Sep 07 17:59:48 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:59:48 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root
Sep 07 17:59:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5da44b63-8a3f-479a-b628-f75d97123635 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.0497d97a-c36e-4f4d-bfaa-8887ae02e723 1G" returned: 0 in 0.425s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:59:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5da44b63-8a3f-479a-b628-f75d97123635 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.0497d97a-c36e-4f4d-bfaa-8887ae02e723 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:59:48 devstack sudo[88382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.0497d97a-c36e-4f4d-bfaa-8887ae02e723
Sep 07 17:59:48 devstack sudo[88382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:59:48 devstack sudo[88382]: pam_unix(sudo:session): session closed for user root
Sep 07 17:59:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5da44b63-8a3f-479a-b628-f75d97123635 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.0497d97a-c36e-4f4d-bfaa-8887ae02e723" returned: 0 in 0.400s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:59:48 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-5da44b63-8a3f-479a-b628-f75d97123635 tempest-GroupSnapshotsTest-319184014 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.0497d97a-c36e-4f4d-bfaa-8887ae02e723 is being set with open permissions: ugo+rw: NotImplementedError
Sep 07 17:59:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5da44b63-8a3f-479a-b628-f75d97123635 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.0497d97a-c36e-4f4d-bfaa-8887ae02e723 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:59:48 devstack sudo[88389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.0497d97a-c36e-4f4d-bfaa-8887ae02e723
Sep 07 17:59:48 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:59:49 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root
Sep 07 17:59:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5da44b63-8a3f-479a-b628-f75d97123635 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.0497d97a-c36e-4f4d-bfaa-8887ae02e723" returned: 0 in 0.274s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:59:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5da44b63-8a3f-479a-b628-f75d97123635 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:59:49 devstack sudo[88392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.info
Sep 07 17:59:49 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:59:49 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root
Sep 07 17:59:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5da44b63-8a3f-479a-b628-f75d97123635 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.info" returned: 0 in 0.284s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:59:49 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-5da44b63-8a3f-479a-b628-f75d97123635 tempest-GroupSnapshotsTest-319184014 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 07 17:59:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5da44b63-8a3f-479a-b628-f75d97123635 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:59:49 devstack sudo[88395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.info
Sep 07 17:59:49 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:59:49 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root
Sep 07 17:59:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5da44b63-8a3f-479a-b628-f75d97123635 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.info" returned: 0 in 0.272s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:59:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5da44b63-8a3f-479a-b628-f75d97123635 tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.338s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 17:59:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-a4cfbb0c-6dc9-4a6f-a227-6c961c6f5d9e req-0e9d3309-b326-4ed5-9e83-469c0d602926 tempest-DeleteServersTestJSON-1580364880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.234s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 17:59:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-a4cfbb0c-6dc9-4a6f-a227-6c961c6f5d9e req-0e9d3309-b326-4ed5-9e83-469c0d602926 tempest-DeleteServersTestJSON-1580364880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 17:59:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.875s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 17:59:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T15:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-714649669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca621e5-904e-4e5b-838d-b5705e4ece73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dccc151571794b928c60bffe89fb6767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:59:48Z,use_quota=True,user_id='85947174acd14c5688f5e1c02616cba3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 17:59:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Creating volume cca621e5-904e-4e5b-838d-b5705e4ece73 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 17:59:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 17:59:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 17:59:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 17:59:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 17:59:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 17:59:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 17:59:49 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 17:59:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cca621e5-904e-4e5b-838d-b5705e4ece73 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:59:49 devstack sudo[88398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cca621e5-904e-4e5b-838d-b5705e4ece73 1073741824
Sep 07 17:59:49 devstack sudo[88398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:59:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-a4cfbb0c-6dc9-4a6f-a227-6c961c6f5d9e req-0e9d3309-b326-4ed5-9e83-469c0d602926 tempest-DeleteServersTestJSON-1580364880 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d', 'name': 'volume-8176ebdb-0f79-4f7a-8518-10fb8e402c9b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c88f9a4d-92be-4e0b-b896-a50cfc78e471', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 07 17:59:50 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5da44b63-8a3f-479a-b628-f75d97123635 tempest-GroupSnapshotsTest-319184014 None] group_snapshot 5dbd2dfe-78bc-43f6-a64e-c33d23f89c59: created successfully
Sep 07 17:59:50 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-a4cfbb0c-6dc9-4a6f-a227-6c961c6f5d9e req-0e9d3309-b326-4ed5-9e83-469c0d602926 tempest-DeleteServersTestJSON-1580364880 None] attachment_update completed successfully.
Sep 07 17:59:50 devstack sudo[88398]: pam_unix(sudo:session): session closed for user root
Sep 07 17:59:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cca621e5-904e-4e5b-838d-b5705e4ece73 1073741824" returned: 0 in 0.551s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:59:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cca621e5-904e-4e5b-838d-b5705e4ece73 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:59:50 devstack sudo[88427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cca621e5-904e-4e5b-838d-b5705e4ece73
Sep 07 17:59:50 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:59:50 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root
Sep 07 17:59:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cca621e5-904e-4e5b-838d-b5705e4ece73" returned: 0 in 0.362s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:59:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 17:59:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 17:59:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a872d3-5996-4e87-85e0-dfda407b2e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cca621e5-904e-4e5b-838d-b5705e4ece73', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 17:59:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbd0152b-0ff0-44b0-85a0-47bfe27b9783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 17:59:50 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Volume volume-cca621e5-904e-4e5b-838d-b5705e4ece73 (cca621e5-904e-4e5b-838d-b5705e4ece73): created successfully
Sep 07 17:59:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbd0152b-0ff0-44b0-85a0-47bfe27b9783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 17:59:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Flow 'volume_create_manager' (1fd5f5ff-07ba-42c4-a18c-cd8c0315778a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 17:59:50 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-40d27d8d-2b4a-4b94-9e71-e460b54e1d17 tempest-VolumesAdminNegativeTest-1246264397 None] Created volume successfully.
Sep 07 17:59:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 17:59:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 17:59:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "cinder-quobyte-0497d97a-c36e-4f4d-bfaa-8887ae02e723-a64bc44c-f825-44d8-a9a7-fabdd5587809" by "_create_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 17:59:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6fb7cef4-d75c-4702-8c73-ff5183be81ee tempest-VolumesAdminNegativeTest-1246264397 None] Acquiring lock "cinder-cca621e5-904e-4e5b-838d-b5705e4ece73-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 17:59:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-0497d97a-c36e-4f4d-bfaa-8887ae02e723-a64bc44c-f825-44d8-a9a7-fabdd5587809" acquired by "_create_volume_from_snapshot" :: waited 0.069s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 17:59:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Creating volume a64bc44c-f825-44d8-a9a7-fabdd5587809 from snapshot 0497d97a-c36e-4f4d-bfaa-8887ae02e723 {{(pid=87269) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 07 17:59:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 17:59:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 17:59:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 17:59:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 17:59:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 17:59:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 17:59:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "cinder-quobyte-a64bc44c-f825-44d8-a9a7-fabdd5587809" by "_copy_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 17:59:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6fb7cef4-d75c-4702-8c73-ff5183be81ee tempest-VolumesAdminNegativeTest-1246264397 None] Lock "cinder-cca621e5-904e-4e5b-838d-b5705e4ece73-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 17:59:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-a64bc44c-f825-44d8-a9a7-fabdd5587809" acquired by "_copy_volume_from_snapshot" :: waited 0.065s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 17:59:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] snapshot: 0497d97a-c36e-4f4d-bfaa-8887ae02e723, volume: a64bc44c-f825-44d8-a9a7-fabdd5587809,  {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 07 17:59:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 17:59:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 17:59:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 17:59:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 17:59:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 17:59:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6fb7cef4-d75c-4702-8c73-ff5183be81ee tempest-VolumesAdminNegativeTest-1246264397 None] Acquiring lock "cinder-quobyte-cca621e5-904e-4e5b-838d-b5705e4ece73" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 17:59:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6fb7cef4-d75c-4702-8c73-ff5183be81ee tempest-VolumesAdminNegativeTest-1246264397 None] Lock "cinder-quobyte-cca621e5-904e-4e5b-838d-b5705e4ece73" acquired by "delete_volume" :: waited 0.027s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 17:59:52 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2f02cb-5b73-48d6-b417-32d85f791ff1]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 17:59:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.0497d97a-c36e-4f4d-bfaa-8887ae02e723 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:59:52 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e45618b-ea4b-437f-a8a5-5615b1d0f825]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 17:59:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6fb7cef4-d75c-4702-8c73-ff5183be81ee tempest-VolumesAdminNegativeTest-1246264397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cca621e5-904e-4e5b-838d-b5705e4ece73 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:59:52 devstack sudo[88794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.0497d97a-c36e-4f4d-bfaa-8887ae02e723
Sep 07 17:59:52 devstack sudo[88794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:59:52 devstack sudo[88795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cca621e5-904e-4e5b-838d-b5705e4ece73
Sep 07 17:59:52 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:59:53 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root
Sep 07 17:59:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6fb7cef4-d75c-4702-8c73-ff5183be81ee tempest-VolumesAdminNegativeTest-1246264397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cca621e5-904e-4e5b-838d-b5705e4ece73" returned: 0 in 0.603s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:59:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6fb7cef4-d75c-4702-8c73-ff5183be81ee tempest-VolumesAdminNegativeTest-1246264397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cca621e5-904e-4e5b-838d-b5705e4ece73 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:59:53 devstack sudo[88801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cca621e5-904e-4e5b-838d-b5705e4ece73
Sep 07 17:59:53 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:59:53 devstack sudo[88794]: pam_unix(sudo:session): session closed for user root
Sep 07 17:59:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.0497d97a-c36e-4f4d-bfaa-8887ae02e723" returned: 0 in 0.919s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:59:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 17:59:53 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9984c4a-9a9f-4abf-92be-d5e18086a4a3]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 17:59:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:59:53 devstack sudo[88808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe
Sep 07 17:59:53 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:59:53 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root
Sep 07 17:59:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6fb7cef4-d75c-4702-8c73-ff5183be81ee tempest-VolumesAdminNegativeTest-1246264397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cca621e5-904e-4e5b-838d-b5705e4ece73" returned: 0 in 0.500s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:59:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6fb7cef4-d75c-4702-8c73-ff5183be81ee tempest-VolumesAdminNegativeTest-1246264397 None] Lock "cinder-quobyte-cca621e5-904e-4e5b-838d-b5705e4ece73" released by "delete_volume" :: held 1.206s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 17:59:53 devstack cinder-volume[87269]: WARNING cinder.quota [None req-6fb7cef4-d75c-4702-8c73-ff5183be81ee tempest-VolumesAdminNegativeTest-1246264397 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 07 17:59:53 devstack cinder-volume[87269]: WARNING cinder.quota [None req-6fb7cef4-d75c-4702-8c73-ff5183be81ee tempest-VolumesAdminNegativeTest-1246264397 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 07 17:59:53 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-6fb7cef4-d75c-4702-8c73-ff5183be81ee tempest-VolumesAdminNegativeTest-1246264397 None] Created reservations ['223c3959-a78b-45d1-985b-79041709242d', 'b4456288-1320-43a4-85d8-e7858552ae1a', '254568f6-2cac-4422-bccf-6b8c46131013', '12caf526-6403-4c99-a83e-4b039bdd9a41'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 17:59:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6fb7cef4-d75c-4702-8c73-ff5183be81ee tempest-VolumesAdminNegativeTest-1246264397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 17:59:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6fb7cef4-d75c-4702-8c73-ff5183be81ee tempest-VolumesAdminNegativeTest-1246264397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 17:59:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6fb7cef4-d75c-4702-8c73-ff5183be81ee tempest-VolumesAdminNegativeTest-1246264397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 17:59:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6fb7cef4-d75c-4702-8c73-ff5183be81ee tempest-VolumesAdminNegativeTest-1246264397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 17:59:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6fb7cef4-d75c-4702-8c73-ff5183be81ee tempest-VolumesAdminNegativeTest-1246264397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 17:59:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6fb7cef4-d75c-4702-8c73-ff5183be81ee tempest-VolumesAdminNegativeTest-1246264397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:59:54 devstack sudo[88859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 17:59:54 devstack sudo[88859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:59:54 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root
Sep 07 17:59:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe" returned: 0 in 0.960s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:59:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] will copy from snapshot at /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 07 17:59:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Creating direct copy from snapshot {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 07 17:59:54 devstack cinder-volume[87269]: DEBUG cinder.utils [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Path /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a64bc44c-f825-44d8-a9a7-fabdd5587809 not found in is_blk_device check {{(pid=87269) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 07 17:59:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a64bc44c-f825-44d8-a9a7-fabdd5587809 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 17:59:54 devstack sudo[88861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a64bc44c-f825-44d8-a9a7-fabdd5587809
Sep 07 17:59:54 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 17:59:55 devstack sudo[88859]: pam_unix(sudo:session): session closed for user root
Sep 07 17:59:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6fb7cef4-d75c-4702-8c73-ff5183be81ee tempest-VolumesAdminNegativeTest-1246264397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.656s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 17:59:55 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-6fb7cef4-d75c-4702-8c73-ff5183be81ee tempest-VolumesAdminNegativeTest-1246264397 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 17:59:55 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-6fb7cef4-d75c-4702-8c73-ff5183be81ee tempest-VolumesAdminNegativeTest-1246264397 None] Deleted volume successfully.
Sep 07 17:59:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6fb7cef4-d75c-4702-8c73-ff5183be81ee tempest-VolumesAdminNegativeTest-1246264397 None] Lock "cinder-cca621e5-904e-4e5b-838d-b5705e4ece73-delete_volume" released by "delete_volume" :: held 2.786s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 17:59:56 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-d9db9421-9aa7-4b59-b390-b43b6e47d955 req-e23551e5-0c7b-49bd-b35e-97fa88faad7b tempest-DeleteServersTestJSON-1580364880 None] Terminate volume connection completed successfully.
Sep 07 17:59:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-d9db9421-9aa7-4b59-b390-b43b6e47d955 req-e23551e5-0c7b-49bd-b35e-97fa88faad7b tempest-DeleteServersTestJSON-1580364880 None] Deleting attachment c88f9a4d-92be-4e0b-b896-a50cfc78e471. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 07 18:00:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d89a4a88-3a56-479f-996e-34c1a2b24ed9 tempest-DeleteServersTestJSON-1580364880 None] Acquiring lock "cinder-8176ebdb-0f79-4f7a-8518-10fb8e402c9b-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:00:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d89a4a88-3a56-479f-996e-34c1a2b24ed9 tempest-DeleteServersTestJSON-1580364880 None] Lock "cinder-8176ebdb-0f79-4f7a-8518-10fb8e402c9b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:00:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d89a4a88-3a56-479f-996e-34c1a2b24ed9 tempest-DeleteServersTestJSON-1580364880 None] Acquiring lock "cinder-quobyte-8176ebdb-0f79-4f7a-8518-10fb8e402c9b" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:00:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d89a4a88-3a56-479f-996e-34c1a2b24ed9 tempest-DeleteServersTestJSON-1580364880 None] Lock "cinder-quobyte-8176ebdb-0f79-4f7a-8518-10fb8e402c9b" acquired by "delete_volume" :: waited 0.027s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:00:00 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c488fa1-3523-49c3-a435-4a3fdab50f28]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:00:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d89a4a88-3a56-479f-996e-34c1a2b24ed9 tempest-DeleteServersTestJSON-1580364880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8176ebdb-0f79-4f7a-8518-10fb8e402c9b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:00 devstack sudo[88959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8176ebdb-0f79-4f7a-8518-10fb8e402c9b
Sep 07 18:00:00 devstack sudo[88959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:00 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:00:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:00:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:00:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:00:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:00:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:00:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:00 devstack sudo[88961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:00:00 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:01 devstack sudo[88959]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d89a4a88-3a56-479f-996e-34c1a2b24ed9 tempest-DeleteServersTestJSON-1580364880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8176ebdb-0f79-4f7a-8518-10fb8e402c9b" returned: 0 in 0.822s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d89a4a88-3a56-479f-996e-34c1a2b24ed9 tempest-DeleteServersTestJSON-1580364880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8176ebdb-0f79-4f7a-8518-10fb8e402c9b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:01 devstack sudo[88966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8176ebdb-0f79-4f7a-8518-10fb8e402c9b
Sep 07 18:00:01 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:01 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.954s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:00:01 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:00:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread count: 8 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 07 18:00:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread info: [<_MainThread(MainThread, started 137533762306176)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137533650971072)>, <Thread(Thread-3 (stat_writer), started daemon 137533647226880)>, <Thread(Rabbit-heartbeat, started daemon 137533647437120)>, <Thread(Thread-5 (_runner), started daemon 137533648120896)>, <Thread(Thread-7 (_runner), started daemon 137533648182592)>, <Thread(fd_logger, started daemon 137533644336576)>, <Thread(privsep_reader, started daemon 137533643255424)>] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 07 18:00:01 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a64bc44c-f825-44d8-a9a7-fabdd5587809" returned: 0 in 7.323s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:01 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Image conversion details: src /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe, size 1024.00 MB, duration 7.32 sec, destination /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a64bc44c-f825-44d8-a9a7-fabdd5587809 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 07 18:00:01 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Converted 1024.00 MB image at 139.82 MB/s
Sep 07 18:00:01 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a64bc44c-f825-44d8-a9a7-fabdd5587809 is being set with open permissions: ugo+rw: NotImplementedError
Sep 07 18:00:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a64bc44c-f825-44d8-a9a7-fabdd5587809 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:01 devstack sudo[88971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a64bc44c-f825-44d8-a9a7-fabdd5587809
Sep 07 18:00:01 devstack sudo[88971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:01 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d89a4a88-3a56-479f-996e-34c1a2b24ed9 tempest-DeleteServersTestJSON-1580364880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8176ebdb-0f79-4f7a-8518-10fb8e402c9b" returned: 0 in 0.540s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d89a4a88-3a56-479f-996e-34c1a2b24ed9 tempest-DeleteServersTestJSON-1580364880 None] Lock "cinder-quobyte-8176ebdb-0f79-4f7a-8518-10fb8e402c9b" released by "delete_volume" :: held 1.448s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:00:01 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-d89a4a88-3a56-479f-996e-34c1a2b24ed9 tempest-DeleteServersTestJSON-1580364880 None] Created reservations ['4742aabf-8425-495f-9e84-8ca9583417c9', '758b424d-ee94-446d-a847-02158d9699d3', '67cd278f-1405-4b1a-aca0-297015b5ad49', 'fb556f83-9fdf-4b2e-91b3-f4c7ba6d8db5'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:00:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d89a4a88-3a56-479f-996e-34c1a2b24ed9 tempest-DeleteServersTestJSON-1580364880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:00:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d89a4a88-3a56-479f-996e-34c1a2b24ed9 tempest-DeleteServersTestJSON-1580364880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:00:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d89a4a88-3a56-479f-996e-34c1a2b24ed9 tempest-DeleteServersTestJSON-1580364880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:00:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d89a4a88-3a56-479f-996e-34c1a2b24ed9 tempest-DeleteServersTestJSON-1580364880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:00:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d89a4a88-3a56-479f-996e-34c1a2b24ed9 tempest-DeleteServersTestJSON-1580364880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:00:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d89a4a88-3a56-479f-996e-34c1a2b24ed9 tempest-DeleteServersTestJSON-1580364880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:01 devstack sudo[88974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:00:02 devstack sudo[88974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:02 devstack sudo[88971]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a64bc44c-f825-44d8-a9a7-fabdd5587809" returned: 0 in 0.327s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-a64bc44c-f825-44d8-a9a7-fabdd5587809" released by "_copy_volume_from_snapshot" :: held 9.722s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:00:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-0497d97a-c36e-4f4d-bfaa-8887ae02e723-a64bc44c-f825-44d8-a9a7-fabdd5587809" released by "_create_volume_from_snapshot" :: held 9.884s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:00:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.954s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:00:02 devstack sudo[88974]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d89a4a88-3a56-479f-996e-34c1a2b24ed9 tempest-DeleteServersTestJSON-1580364880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.353s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:02 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-d89a4a88-3a56-479f-996e-34c1a2b24ed9 tempest-DeleteServersTestJSON-1580364880 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:00:02 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d89a4a88-3a56-479f-996e-34c1a2b24ed9 tempest-DeleteServersTestJSON-1580364880 None] Deleted volume successfully.
Sep 07 18:00:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d89a4a88-3a56-479f-996e-34c1a2b24ed9 tempest-DeleteServersTestJSON-1580364880 None] Lock "cinder-8176ebdb-0f79-4f7a-8518-10fb8e402c9b-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:00:02 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9ccd7808-26ce-4ef6-9dc6-9fd81262f02d tempest-GroupSnapshotsTest-319184014 None] Create group from source-snapshot-5dbd2dfe-78bc-43f6-a64e-c33d23f89c59 completed successfully.
Sep 07 18:00:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5c1b0107-adba-463f-a928-5101182634e3 tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "cinder-quobyte-a64bc44c-f825-44d8-a9a7-fabdd5587809" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:00:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5c1b0107-adba-463f-a928-5101182634e3 tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-a64bc44c-f825-44d8-a9a7-fabdd5587809" acquired by "delete_volume" :: waited 0.027s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:00:02 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bc928f-d361-49ef-8019-7c14045b2fdd]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:00:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5c1b0107-adba-463f-a928-5101182634e3 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a64bc44c-f825-44d8-a9a7-fabdd5587809 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:03 devstack sudo[88978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a64bc44c-f825-44d8-a9a7-fabdd5587809
Sep 07 18:00:03 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:03 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5c1b0107-adba-463f-a928-5101182634e3 tempest-GroupSnapshotsTest-319184014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a64bc44c-f825-44d8-a9a7-fabdd5587809" returned: 0 in 0.410s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5c1b0107-adba-463f-a928-5101182634e3 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a64bc44c-f825-44d8-a9a7-fabdd5587809 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:03 devstack sudo[88984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a64bc44c-f825-44d8-a9a7-fabdd5587809
Sep 07 18:00:03 devstack sudo[88984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:03 devstack sudo[88984]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5c1b0107-adba-463f-a928-5101182634e3 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a64bc44c-f825-44d8-a9a7-fabdd5587809" returned: 0 in 0.242s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5c1b0107-adba-463f-a928-5101182634e3 tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-a64bc44c-f825-44d8-a9a7-fabdd5587809" released by "delete_volume" :: held 0.707s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:00:03 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-5c1b0107-adba-463f-a928-5101182634e3 tempest-GroupSnapshotsTest-319184014 None] Created reservations ['2042e443-6d99-40c4-b8d1-387f9fd68585'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:00:03 devstack cinder-volume[87269]: WARNING cinder.quota [None req-5c1b0107-adba-463f-a928-5101182634e3 tempest-GroupSnapshotsTest-319184014 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-291891407 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-291891407, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:00:03 devstack cinder-volume[87269]: WARNING cinder.quota [None req-5c1b0107-adba-463f-a928-5101182634e3 tempest-GroupSnapshotsTest-319184014 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-291891407 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-291891407, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:00:03 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-5c1b0107-adba-463f-a928-5101182634e3 tempest-GroupSnapshotsTest-319184014 None] Created reservations ['dac04b23-c4ea-43ee-b76f-828d1553324b', '93137144-4723-4479-a602-08334c8d60b0', '05a88ba1-8b56-44bd-9c1a-d78a76f1f81f', 'e07dd13e-0665-4e40-bcda-1779efb0f8ae'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:00:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5c1b0107-adba-463f-a928-5101182634e3 tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:00:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5c1b0107-adba-463f-a928-5101182634e3 tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:00:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5c1b0107-adba-463f-a928-5101182634e3 tempest-GroupSnapshotsTest-319184014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:00:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5c1b0107-adba-463f-a928-5101182634e3 tempest-GroupSnapshotsTest-319184014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:00:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5c1b0107-adba-463f-a928-5101182634e3 tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:00:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5c1b0107-adba-463f-a928-5101182634e3 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:03 devstack sudo[88987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:00:03 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:04 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5c1b0107-adba-463f-a928-5101182634e3 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.321s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:04 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-5c1b0107-adba-463f-a928-5101182634e3 tempest-GroupSnapshotsTest-319184014 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:00:04 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5c1b0107-adba-463f-a928-5101182634e3 tempest-GroupSnapshotsTest-319184014 None] Delete group completed successfully.
Sep 07 18:00:04 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a751e369-827a-4c4d-a22c-b9fa61c5969f tempest-GroupSnapshotsTest-319184014 None] group_snapshot 5dbd2dfe-78bc-43f6-a64e-c33d23f89c59: deleting
Sep 07 18:00:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a751e369-827a-4c4d-a22c-b9fa61c5969f tempest-GroupSnapshotsTest-319184014 None] group_snapshot 5dbd2dfe-78bc-43f6-a64e-c33d23f89c59: deleting {{(pid=87269) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 07 18:00:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a751e369-827a-4c4d-a22c-b9fa61c5969f tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "cinder-quobyte-ca090d23-9f2e-4c55-ade4-d6d394cb90fe" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:00:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a751e369-827a-4c4d-a22c-b9fa61c5969f tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-ca090d23-9f2e-4c55-ade4-d6d394cb90fe" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:00:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a751e369-827a-4c4d-a22c-b9fa61c5969f tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "cinder-quobyte-0497d97a-c36e-4f4d-bfaa-8887ae02e723" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:00:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a751e369-827a-4c4d-a22c-b9fa61c5969f tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-0497d97a-c36e-4f4d-bfaa-8887ae02e723" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:00:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a751e369-827a-4c4d-a22c-b9fa61c5969f tempest-GroupSnapshotsTest-319184014 None] Deleting offline snapshot 0497d97a-c36e-4f4d-bfaa-8887ae02e723 of volume ca090d23-9f2e-4c55-ade4-d6d394cb90fe {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:00:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a751e369-827a-4c4d-a22c-b9fa61c5969f tempest-GroupSnapshotsTest-319184014 None] snapshot_file for this snap is: volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.0497d97a-c36e-4f4d-bfaa-8887ae02e723 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:00:04 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[505ad27b-2961-4dcd-9a95-16dac9e2b663]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:00:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a751e369-827a-4c4d-a22c-b9fa61c5969f tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.0497d97a-c36e-4f4d-bfaa-8887ae02e723 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:04 devstack sudo[88990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.0497d97a-c36e-4f4d-bfaa-8887ae02e723
Sep 07 18:00:04 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:04 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a751e369-827a-4c4d-a22c-b9fa61c5969f tempest-GroupSnapshotsTest-319184014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.0497d97a-c36e-4f4d-bfaa-8887ae02e723" returned: 0 in 0.434s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a751e369-827a-4c4d-a22c-b9fa61c5969f tempest-GroupSnapshotsTest-319184014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:00:04 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfffe56-2782-41ac-a767-e0305697e0af]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:00:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a751e369-827a-4c4d-a22c-b9fa61c5969f tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:05 devstack sudo[88996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe
Sep 07 18:00:05 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:05 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a751e369-827a-4c4d-a22c-b9fa61c5969f tempest-GroupSnapshotsTest-319184014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe" returned: 0 in 0.562s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a751e369-827a-4c4d-a22c-b9fa61c5969f tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.0497d97a-c36e-4f4d-bfaa-8887ae02e723 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:05 devstack sudo[89002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.0497d97a-c36e-4f4d-bfaa-8887ae02e723
Sep 07 18:00:05 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:05 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a751e369-827a-4c4d-a22c-b9fa61c5969f tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.0497d97a-c36e-4f4d-bfaa-8887ae02e723" returned: 0 in 0.353s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a751e369-827a-4c4d-a22c-b9fa61c5969f tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.0497d97a-c36e-4f4d-bfaa-8887ae02e723 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:05 devstack sudo[89008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.0497d97a-c36e-4f4d-bfaa-8887ae02e723
Sep 07 18:00:05 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:06 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a751e369-827a-4c4d-a22c-b9fa61c5969f tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe.0497d97a-c36e-4f4d-bfaa-8887ae02e723" returned: 0 in 0.293s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a751e369-827a-4c4d-a22c-b9fa61c5969f tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-0497d97a-c36e-4f4d-bfaa-8887ae02e723" released by "_delete_snapshot" :: held 1.754s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:00:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a751e369-827a-4c4d-a22c-b9fa61c5969f tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-ca090d23-9f2e-4c55-ade4-d6d394cb90fe" released by "delete_snapshot" :: held 1.782s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:00:06 devstack cinder-volume[87269]: WARNING cinder.quota [None req-a751e369-827a-4c4d-a22c-b9fa61c5969f tempest-GroupSnapshotsTest-319184014 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-291891407 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-291891407, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:00:06 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-a751e369-827a-4c4d-a22c-b9fa61c5969f tempest-GroupSnapshotsTest-319184014 None] Created reservations ['3e313f08-48de-4f36-98b1-df5c3f3a0a30', '34afcc2f-6e54-4320-b621-8693874b4710', '4053d845-1f41-473d-9157-7d4242fdf7fa', '887cd38c-8340-46b9-9624-58959730a783'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:00:06 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a751e369-827a-4c4d-a22c-b9fa61c5969f tempest-GroupSnapshotsTest-319184014 None] group_snapshot 5dbd2dfe-78bc-43f6-a64e-c33d23f89c59: deleted successfully
Sep 07 18:00:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-334dc83d-6d82-44e8-a51a-eb0e61a314fc tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "cinder-quobyte-ca090d23-9f2e-4c55-ade4-d6d394cb90fe" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:00:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-334dc83d-6d82-44e8-a51a-eb0e61a314fc tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-ca090d23-9f2e-4c55-ade4-d6d394cb90fe" acquired by "delete_volume" :: waited 0.027s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:00:07 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d99346-87f8-4aa0-9419-09950bbaf40a]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:00:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-334dc83d-6d82-44e8-a51a-eb0e61a314fc tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:07 devstack sudo[89012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe
Sep 07 18:00:07 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:07 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-334dc83d-6d82-44e8-a51a-eb0e61a314fc tempest-GroupSnapshotsTest-319184014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe" returned: 0 in 0.546s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-334dc83d-6d82-44e8-a51a-eb0e61a314fc tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:07 devstack sudo[89017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe
Sep 07 18:00:07 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:07 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-334dc83d-6d82-44e8-a51a-eb0e61a314fc tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ca090d23-9f2e-4c55-ade4-d6d394cb90fe" returned: 0 in 0.286s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-334dc83d-6d82-44e8-a51a-eb0e61a314fc tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-ca090d23-9f2e-4c55-ade4-d6d394cb90fe" released by "delete_volume" :: held 0.946s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:00:07 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-334dc83d-6d82-44e8-a51a-eb0e61a314fc tempest-GroupSnapshotsTest-319184014 None] Created reservations ['2e8b9ef5-3fef-49bf-bf46-cf55760b9d9d'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:00:08 devstack cinder-volume[87269]: WARNING cinder.db.api [None req-334dc83d-6d82-44e8-a51a-eb0e61a314fc tempest-GroupSnapshotsTest-319184014 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-291891407']
Sep 07 18:00:08 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-334dc83d-6d82-44e8-a51a-eb0e61a314fc tempest-GroupSnapshotsTest-319184014 None] Created reservations ['b3bd0134-cd0a-4a3d-a57a-f3204fcd0eeb', 'fc0e7f75-6aec-4248-8103-efc28b8043ac', '5f0c9be7-11b8-4ab1-9743-7d77f97b4c8e', '387e972d-009e-4fc3-a6d9-c2a790fa4eb1'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:00:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-334dc83d-6d82-44e8-a51a-eb0e61a314fc tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:00:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-334dc83d-6d82-44e8-a51a-eb0e61a314fc tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:00:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-334dc83d-6d82-44e8-a51a-eb0e61a314fc tempest-GroupSnapshotsTest-319184014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:00:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-334dc83d-6d82-44e8-a51a-eb0e61a314fc tempest-GroupSnapshotsTest-319184014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:00:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-334dc83d-6d82-44e8-a51a-eb0e61a314fc tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:00:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-334dc83d-6d82-44e8-a51a-eb0e61a314fc tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:08 devstack sudo[89020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:00:08 devstack sudo[89020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:08 devstack sudo[89020]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-334dc83d-6d82-44e8-a51a-eb0e61a314fc tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.327s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:08 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-334dc83d-6d82-44e8-a51a-eb0e61a314fc tempest-GroupSnapshotsTest-319184014 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:00:08 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-334dc83d-6d82-44e8-a51a-eb0e61a314fc tempest-GroupSnapshotsTest-319184014 None] Delete group completed successfully.
Sep 07 18:00:09 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-1f0800bf-bf11-49ae-ba37-4b076582a70a tempest-GroupSnapshotsTest-319184014 None] Group tempest-GroupSnapshotsTest-Group-2138327335: creating
Sep 07 18:00:09 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-1f0800bf-bf11-49ae-ba37-4b076582a70a tempest-GroupSnapshotsTest-319184014 None] Group tempest-GroupSnapshotsTest-Group-2138327335: created successfully
Sep 07 18:00:09 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-1f0800bf-bf11-49ae-ba37-4b076582a70a tempest-GroupSnapshotsTest-319184014 None] Create group completed successfully.
Sep 07 18:00:11 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:00:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Flow 'volume_create_manager' (13ecc02c-75dd-46bb-bd39-851012422262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:00:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aabc3b76-ff14-4834-8433-f3e2b4c961bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:00:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aabc3b76-ff14-4834-8433-f3e2b4c961bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-102607324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1698ddc1-5a3f-45a9-b973-de243ef50216,host='devstack@QuobyteHD#QuobyteHD',id=9b9b7000-1065-42f0-a768-28595e379c65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e587b279cef4d6d8329519aa853c0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:00:12Z,use_quota=True,user_id='55884fccbae9432aa03f85e4eed4ca39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74271f1f-2ec9-4dc7-90de-51b54d7e00a4),volume_type_id=74271f1f-2ec9-4dc7-90de-51b54d7e00a4)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:00:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7f25c6-cd23-4969-8146-10a24b02ceb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:00:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7f25c6-cd23-4969-8146-10a24b02ceb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:00:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b757566-2ffa-4d66-b6ba-8fabe20a0dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:00:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b757566-2ffa-4d66-b6ba-8fabe20a0dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b9b7000-1065-42f0-a768-28595e379c65', 'volume_name': 'volume-9b9b7000-1065-42f0-a768-28595e379c65', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:00:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e3718d-e408-41c9-9ab2-e6860d42c550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:00:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e3718d-e408-41c9-9ab2-e6860d42c550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:00:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25cc8001-3c9d-44d5-9d33-cba1ed870dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:00:11 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Volume 9b9b7000-1065-42f0-a768-28595e379c65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b9b7000-1065-42f0-a768-28595e379c65', 'volume_size': 1}
Sep 07 18:00:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:00:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:00:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1698ddc1-5a3f-45a9-b973-de243ef50216,created_at=2026-09-07T16:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-102607324',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1698ddc1-5a3f-45a9-b973-de243ef50216,host='devstack@QuobyteHD#QuobyteHD',id=9b9b7000-1065-42f0-a768-28595e379c65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e587b279cef4d6d8329519aa853c0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:00:12Z,use_quota=True,user_id='55884fccbae9432aa03f85e4eed4ca39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74271f1f-2ec9-4dc7-90de-51b54d7e00a4),volume_type_id=74271f1f-2ec9-4dc7-90de-51b54d7e00a4)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:00:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Creating volume 9b9b7000-1065-42f0-a768-28595e379c65 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:00:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:00:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:00:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:00:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:00:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:00:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:00:11 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:00:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:11 devstack sudo[89028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65 1073741824
Sep 07 18:00:11 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:12 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65 1073741824" returned: 0 in 0.513s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:12 devstack sudo[89033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65
Sep 07 18:00:12 devstack sudo[89033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:12 devstack sudo[89033]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65" returned: 0 in 0.303s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:00:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:00:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25cc8001-3c9d-44d5-9d33-cba1ed870dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b9b7000-1065-42f0-a768-28595e379c65', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:00:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6010202f-3ede-41a9-a34e-323a7995e160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:00:12 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Volume volume-9b9b7000-1065-42f0-a768-28595e379c65 (9b9b7000-1065-42f0-a768-28595e379c65): created successfully
Sep 07 18:00:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6010202f-3ede-41a9-a34e-323a7995e160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:00:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Flow 'volume_create_manager' (13ecc02c-75dd-46bb-bd39-851012422262) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:00:12 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-381faa11-f1be-4455-af99-69f997a33caf tempest-GroupSnapshotsTest-319184014 None] Created volume successfully.
Sep 07 18:00:13 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:00:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Flow 'volume_create_manager' (1ababe73-cae2-47b5-8427-510d85804e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:00:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4ceeb3-c923-4360-8434-6060fd59e7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:00:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df4ceeb3-c923-4360-8434-6060fd59e7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1808149401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1698ddc1-5a3f-45a9-b973-de243ef50216,host='devstack@QuobyteHD#QuobyteHD',id=859cb15b-e634-4ae2-ba76-2a183d5869ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e587b279cef4d6d8329519aa853c0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:00:14Z,use_quota=True,user_id='55884fccbae9432aa03f85e4eed4ca39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74271f1f-2ec9-4dc7-90de-51b54d7e00a4),volume_type_id=74271f1f-2ec9-4dc7-90de-51b54d7e00a4)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:00:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58aaa9b5-c9e7-4356-9b34-353cf2deaf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:00:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58aaa9b5-c9e7-4356-9b34-353cf2deaf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:00:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73fc4352-00fc-45e1-b29a-6b3f65ef89ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:00:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73fc4352-00fc-45e1-b29a-6b3f65ef89ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '859cb15b-e634-4ae2-ba76-2a183d5869ea', 'volume_name': 'volume-859cb15b-e634-4ae2-ba76-2a183d5869ea', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:00:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05f0069d-9827-47a0-b94f-68dd85c9cc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:00:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05f0069d-9827-47a0-b94f-68dd85c9cc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:00:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3461a1a-3b44-4382-8cea-ce27d72cb482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:00:13 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Volume 859cb15b-e634-4ae2-ba76-2a183d5869ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-859cb15b-e634-4ae2-ba76-2a183d5869ea', 'volume_size': 1}
Sep 07 18:00:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:00:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:00:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1698ddc1-5a3f-45a9-b973-de243ef50216,created_at=2026-09-07T16:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1808149401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1698ddc1-5a3f-45a9-b973-de243ef50216,host='devstack@QuobyteHD#QuobyteHD',id=859cb15b-e634-4ae2-ba76-2a183d5869ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e587b279cef4d6d8329519aa853c0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:00:14Z,use_quota=True,user_id='55884fccbae9432aa03f85e4eed4ca39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(74271f1f-2ec9-4dc7-90de-51b54d7e00a4),volume_type_id=74271f1f-2ec9-4dc7-90de-51b54d7e00a4)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:00:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Creating volume 859cb15b-e634-4ae2-ba76-2a183d5869ea {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:00:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:00:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:00:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:00:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:00:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:00:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:00:13 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:00:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:13 devstack sudo[89036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea 1073741824
Sep 07 18:00:13 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:14 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea 1073741824" returned: 0 in 0.513s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:14 devstack sudo[89042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea
Sep 07 18:00:14 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:14 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea" returned: 0 in 0.296s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:00:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:00:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3461a1a-3b44-4382-8cea-ce27d72cb482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-859cb15b-e634-4ae2-ba76-2a183d5869ea', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:00:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc229935-d644-4ec2-a7b0-f293549889c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:00:14 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Volume volume-859cb15b-e634-4ae2-ba76-2a183d5869ea (859cb15b-e634-4ae2-ba76-2a183d5869ea): created successfully
Sep 07 18:00:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc229935-d644-4ec2-a7b0-f293549889c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:00:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Flow 'volume_create_manager' (1ababe73-cae2-47b5-8427-510d85804e56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:00:14 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-649870d3-e1d4-4c6a-9712-5eb3bffd6fae tempest-GroupSnapshotsTest-319184014 None] Created volume successfully.
Sep 07 18:00:15 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f31685cd-a3c4-485e-9acc-a361d2eacdf4 tempest-GroupSnapshotsTest-319184014 None] Update group completed successfully.
Sep 07 18:00:16 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-23072ba3-f43e-4fb0-966c-f9bcd2e53ee1 tempest-GroupSnapshotsTest-319184014 None] Update group completed successfully.
Sep 07 18:00:17 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5176cda3-41cf-47d8-b663-8cb4933b1dbe tempest-GroupSnapshotsTest-319184014 None] Update group completed successfully.
Sep 07 18:00:18 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f6281502-6e12-48ca-8a21-fb31fd9a1c6e tempest-GroupSnapshotsTest-319184014 None] Update group completed successfully.
Sep 07 18:00:20 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] GroupSnapshot ba247a0c-58fe-49b2-9282-3ead865d1d4c: creating.
Sep 07 18:00:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] Group snapshot ba247a0c-58fe-49b2-9282-3ead865d1d4c: creating. {{(pid=87269) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 07 18:00:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:00:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:00:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] Creating offline snapshot 6db6a767-d081-489d-8d4a-963f37b0f66e of volume 859cb15b-e634-4ae2-ba76-2a183d5869ea {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:00:20 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5519b192-8732-41b1-98e1-7c8e66413ec4]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:00:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:20 devstack sudo[89048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea
Sep 07 18:00:20 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:20 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea" returned: 0 in 0.400s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea.6db6a767-d081-489d-8d4a-963f37b0f66e 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:20 devstack sudo[89053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea.6db6a767-d081-489d-8d4a-963f37b0f66e 1G
Sep 07 18:00:20 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:21 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea.6db6a767-d081-489d-8d4a-963f37b0f66e 1G" returned: 0 in 0.591s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-859cb15b-e634-4ae2-ba76-2a183d5869ea -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea.6db6a767-d081-489d-8d4a-963f37b0f66e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:21 devstack sudo[89059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-859cb15b-e634-4ae2-ba76-2a183d5869ea -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea.6db6a767-d081-489d-8d4a-963f37b0f66e
Sep 07 18:00:21 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:21 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-859cb15b-e634-4ae2-ba76-2a183d5869ea -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea.6db6a767-d081-489d-8d4a-963f37b0f66e" returned: 0 in 0.367s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:21 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea.6db6a767-d081-489d-8d4a-963f37b0f66e is being set with open permissions: ugo+rw: NotImplementedError
Sep 07 18:00:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea.6db6a767-d081-489d-8d4a-963f37b0f66e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:21 devstack sudo[89075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea.6db6a767-d081-489d-8d4a-963f37b0f66e
Sep 07 18:00:21 devstack sudo[89075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:22 devstack sudo[89075]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea.6db6a767-d081-489d-8d4a-963f37b0f66e" returned: 0 in 0.245s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:22 devstack sudo[89078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea.info
Sep 07 18:00:22 devstack sudo[89078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:22 devstack sudo[89078]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea.info" returned: 0 in 0.279s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:22 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 07 18:00:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:22 devstack sudo[89081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea.info
Sep 07 18:00:22 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:22 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea.info" returned: 0 in 0.267s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.247s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:00:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:00:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:00:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] Creating offline snapshot e236e414-bec2-4c18-8db0-f437ecf41505 of volume 9b9b7000-1065-42f0-a768-28595e379c65 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:00:22 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0a2023-908d-4f7c-b3ad-66967e235c7f]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:00:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:22 devstack sudo[89084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65
Sep 07 18:00:22 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:23 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65" returned: 0 in 0.396s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65.e236e414-bec2-4c18-8db0-f437ecf41505 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:23 devstack sudo[89090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65.e236e414-bec2-4c18-8db0-f437ecf41505 1G
Sep 07 18:00:23 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:23 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65.e236e414-bec2-4c18-8db0-f437ecf41505 1G" returned: 0 in 0.510s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b9b7000-1065-42f0-a768-28595e379c65 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65.e236e414-bec2-4c18-8db0-f437ecf41505 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:23 devstack sudo[89096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b9b7000-1065-42f0-a768-28595e379c65 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65.e236e414-bec2-4c18-8db0-f437ecf41505
Sep 07 18:00:23 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:24 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b9b7000-1065-42f0-a768-28595e379c65 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65.e236e414-bec2-4c18-8db0-f437ecf41505" returned: 0 in 0.353s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:24 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65.e236e414-bec2-4c18-8db0-f437ecf41505 is being set with open permissions: ugo+rw: NotImplementedError
Sep 07 18:00:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65.e236e414-bec2-4c18-8db0-f437ecf41505 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:24 devstack sudo[89102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65.e236e414-bec2-4c18-8db0-f437ecf41505
Sep 07 18:00:24 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:24 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65.e236e414-bec2-4c18-8db0-f437ecf41505" returned: 0 in 0.289s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:24 devstack sudo[89105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65.info
Sep 07 18:00:24 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:24 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65.info" returned: 0 in 0.278s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:24 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 07 18:00:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:24 devstack sudo[89108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65.info
Sep 07 18:00:24 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:24 devstack sudo[89108]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65.info" returned: 0 in 0.332s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.264s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:00:25 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a9665116-2046-4f31-901d-9146eb45de08 tempest-GroupSnapshotsTest-319184014 None] group_snapshot ba247a0c-58fe-49b2-9282-3ead865d1d4c: created successfully
Sep 07 18:00:25 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] group_snapshot ba247a0c-58fe-49b2-9282-3ead865d1d4c: deleting
Sep 07 18:00:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] group_snapshot ba247a0c-58fe-49b2-9282-3ead865d1d4c: deleting {{(pid=87269) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 07 18:00:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "cinder-quobyte-859cb15b-e634-4ae2-ba76-2a183d5869ea" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:00:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-859cb15b-e634-4ae2-ba76-2a183d5869ea" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:00:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "cinder-quobyte-6db6a767-d081-489d-8d4a-963f37b0f66e" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:00:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-6db6a767-d081-489d-8d4a-963f37b0f66e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:00:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Deleting offline snapshot 6db6a767-d081-489d-8d4a-963f37b0f66e of volume 859cb15b-e634-4ae2-ba76-2a183d5869ea {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:00:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] snapshot_file for this snap is: volume-859cb15b-e634-4ae2-ba76-2a183d5869ea.6db6a767-d081-489d-8d4a-963f37b0f66e {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:00:26 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[14932630-2ea1-4fc1-8204-cf9a7cc16eea]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:00:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea.6db6a767-d081-489d-8d4a-963f37b0f66e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:26 devstack sudo[89112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea.6db6a767-d081-489d-8d4a-963f37b0f66e
Sep 07 18:00:26 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:26 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea.6db6a767-d081-489d-8d4a-963f37b0f66e" returned: 0 in 0.478s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-859cb15b-e634-4ae2-ba76-2a183d5869ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:00:26 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[018a0e02-2842-4882-82eb-ba47088df5a7]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:00:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:26 devstack sudo[89118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea
Sep 07 18:00:26 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:27 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea" returned: 0 in 0.484s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea.6db6a767-d081-489d-8d4a-963f37b0f66e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:27 devstack sudo[89126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea.6db6a767-d081-489d-8d4a-963f37b0f66e
Sep 07 18:00:27 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:27 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea.6db6a767-d081-489d-8d4a-963f37b0f66e" returned: 0 in 0.548s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea.6db6a767-d081-489d-8d4a-963f37b0f66e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:27 devstack sudo[89131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea.6db6a767-d081-489d-8d4a-963f37b0f66e
Sep 07 18:00:27 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:28 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea.6db6a767-d081-489d-8d4a-963f37b0f66e" returned: 0 in 0.380s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-6db6a767-d081-489d-8d4a-963f37b0f66e" released by "_delete_snapshot" :: held 2.052s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:00:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-859cb15b-e634-4ae2-ba76-2a183d5869ea" released by "delete_snapshot" :: held 2.083s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:00:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "cinder-quobyte-9b9b7000-1065-42f0-a768-28595e379c65" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:00:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-9b9b7000-1065-42f0-a768-28595e379c65" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:00:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "cinder-quobyte-e236e414-bec2-4c18-8db0-f437ecf41505" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:00:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-e236e414-bec2-4c18-8db0-f437ecf41505" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:00:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Deleting offline snapshot e236e414-bec2-4c18-8db0-f437ecf41505 of volume 9b9b7000-1065-42f0-a768-28595e379c65 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:00:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] snapshot_file for this snap is: volume-9b9b7000-1065-42f0-a768-28595e379c65.e236e414-bec2-4c18-8db0-f437ecf41505 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:00:28 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c297990-71ed-4392-aead-fdffeccee56b]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:00:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65.e236e414-bec2-4c18-8db0-f437ecf41505 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:28 devstack sudo[89134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65.e236e414-bec2-4c18-8db0-f437ecf41505
Sep 07 18:00:28 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:28 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65.e236e414-bec2-4c18-8db0-f437ecf41505" returned: 0 in 0.532s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b9b7000-1065-42f0-a768-28595e379c65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:00:28 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[075f70d1-f89e-4a27-bbc7-e8eb3a9701da]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:00:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:28 devstack sudo[89140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65
Sep 07 18:00:28 devstack sudo[89140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:29 devstack sudo[89140]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65" returned: 0 in 0.406s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65.e236e414-bec2-4c18-8db0-f437ecf41505 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:29 devstack sudo[89146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65.e236e414-bec2-4c18-8db0-f437ecf41505
Sep 07 18:00:29 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:29 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65.e236e414-bec2-4c18-8db0-f437ecf41505" returned: 0 in 0.478s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65.e236e414-bec2-4c18-8db0-f437ecf41505 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:29 devstack sudo[89152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65.e236e414-bec2-4c18-8db0-f437ecf41505
Sep 07 18:00:29 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:30 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65.e236e414-bec2-4c18-8db0-f437ecf41505" returned: 0 in 0.305s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-e236e414-bec2-4c18-8db0-f437ecf41505" released by "_delete_snapshot" :: held 1.861s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:00:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-9b9b7000-1065-42f0-a768-28595e379c65" released by "delete_snapshot" :: held 1.888s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:00:30 devstack cinder-volume[87269]: WARNING cinder.quota [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-749285970 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-749285970, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:00:30 devstack cinder-volume[87269]: WARNING cinder.quota [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-749285970 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-749285970, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:00:30 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Created reservations ['50bada7e-4341-4b87-a6da-41c10a0365a3', '2538ecc9-0cd7-49e6-ad3e-dff643f73f8a', '9be26167-0b4c-4641-8959-520a0dd40f5b', '92f68568-e191-4394-b209-6ad33ce5edbd'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:00:30 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] Created reservations ['196b20b6-b852-4cf8-bb94-2174d84ea5fb', 'b4cf8b06-42e6-42ae-8dbd-6366ac1b03d5', '81b1ca6e-a5c5-46ba-947a-cfb00f1cf335', '837622a8-11c2-44ec-8332-db7a0cf7a09f'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:00:30 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-114b440d-4227-4bec-a070-ae347d3314e6 tempest-GroupSnapshotsTest-319184014 None] group_snapshot ba247a0c-58fe-49b2-9282-3ead865d1d4c: deleted successfully
Sep 07 18:00:31 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=95,cinder:UPDATE=85,cinder:INSERT=19,cinder:DELETE=1 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:00:31 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=94,cinder:UPDATE=87,cinder:DELETE=6,cinder:INSERT=20 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:00:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-99217ede-1cd1-4a6f-a71e-3951d4a45e87 tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "cinder-quobyte-859cb15b-e634-4ae2-ba76-2a183d5869ea" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:00:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-99217ede-1cd1-4a6f-a71e-3951d4a45e87 tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-859cb15b-e634-4ae2-ba76-2a183d5869ea" acquired by "delete_volume" :: waited 0.045s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:00:31 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf736f7-99e9-45b0-b7d4-c83338546281]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:00:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99217ede-1cd1-4a6f-a71e-3951d4a45e87 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:31 devstack sudo[89156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea
Sep 07 18:00:31 devstack sudo[89156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:31 devstack sudo[89156]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99217ede-1cd1-4a6f-a71e-3951d4a45e87 tempest-GroupSnapshotsTest-319184014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea" returned: 0 in 0.395s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99217ede-1cd1-4a6f-a71e-3951d4a45e87 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:31 devstack sudo[89161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea
Sep 07 18:00:31 devstack sudo[89161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:32 devstack sudo[89161]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99217ede-1cd1-4a6f-a71e-3951d4a45e87 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-859cb15b-e634-4ae2-ba76-2a183d5869ea" returned: 0 in 0.261s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-99217ede-1cd1-4a6f-a71e-3951d4a45e87 tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-859cb15b-e634-4ae2-ba76-2a183d5869ea" released by "delete_volume" :: held 0.764s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:00:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-99217ede-1cd1-4a6f-a71e-3951d4a45e87 tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "cinder-quobyte-9b9b7000-1065-42f0-a768-28595e379c65" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:00:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-99217ede-1cd1-4a6f-a71e-3951d4a45e87 tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-9b9b7000-1065-42f0-a768-28595e379c65" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:00:32 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1279a587-c586-4bf9-9c92-2bba79307e01]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:00:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99217ede-1cd1-4a6f-a71e-3951d4a45e87 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:32 devstack sudo[89164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65
Sep 07 18:00:32 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:32 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99217ede-1cd1-4a6f-a71e-3951d4a45e87 tempest-GroupSnapshotsTest-319184014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65" returned: 0 in 0.546s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99217ede-1cd1-4a6f-a71e-3951d4a45e87 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:32 devstack sudo[89169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65
Sep 07 18:00:32 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:32 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99217ede-1cd1-4a6f-a71e-3951d4a45e87 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b9b7000-1065-42f0-a768-28595e379c65" returned: 0 in 0.316s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-99217ede-1cd1-4a6f-a71e-3951d4a45e87 tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-9b9b7000-1065-42f0-a768-28595e379c65" released by "delete_volume" :: held 0.922s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:00:33 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-99217ede-1cd1-4a6f-a71e-3951d4a45e87 tempest-GroupSnapshotsTest-319184014 None] Created reservations ['60c3f0a4-5a08-4ca0-8d9f-dc2b246980a3'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:00:33 devstack cinder-volume[87269]: WARNING cinder.quota [None req-99217ede-1cd1-4a6f-a71e-3951d4a45e87 tempest-GroupSnapshotsTest-319184014 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-749285970 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-749285970, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:00:33 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-99217ede-1cd1-4a6f-a71e-3951d4a45e87 tempest-GroupSnapshotsTest-319184014 None] Created reservations ['348230e4-8e05-4fab-9586-25fc2c1a3756', '9e5670fc-f9e4-412a-84b6-10527167b92d', '7bfa7814-9785-4bf8-b263-1514af84ba19', '2abe2b1b-83b5-45fc-bd7c-c6ca162bf015'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:00:33 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-99217ede-1cd1-4a6f-a71e-3951d4a45e87 tempest-GroupSnapshotsTest-319184014 None] Created reservations ['74a43f1e-f4d3-4b51-a0a9-0d5f248c1828', 'fd94bfcf-9af7-43b7-b90c-b1c54d33496b', '24f88530-6a8a-4fb4-9cc4-0eb599f0a8df', 'c07cb10f-6902-4596-8158-2012f35dd58b'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:00:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-99217ede-1cd1-4a6f-a71e-3951d4a45e87 tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:00:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-99217ede-1cd1-4a6f-a71e-3951d4a45e87 tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:00:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-99217ede-1cd1-4a6f-a71e-3951d4a45e87 tempest-GroupSnapshotsTest-319184014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:00:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-99217ede-1cd1-4a6f-a71e-3951d4a45e87 tempest-GroupSnapshotsTest-319184014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:00:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-99217ede-1cd1-4a6f-a71e-3951d4a45e87 tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:00:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99217ede-1cd1-4a6f-a71e-3951d4a45e87 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:33 devstack sudo[89172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:00:33 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:33 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99217ede-1cd1-4a6f-a71e-3951d4a45e87 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.297s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:33 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-99217ede-1cd1-4a6f-a71e-3951d4a45e87 tempest-GroupSnapshotsTest-319184014 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:00:33 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-99217ede-1cd1-4a6f-a71e-3951d4a45e87 tempest-GroupSnapshotsTest-319184014 None] Delete group completed successfully.
Sep 07 18:00:34 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ff241b14-0f3a-42ae-9b32-a67d2e84bc27 tempest-GroupSnapshotsTest-319184014 None] Group tempest-GroupSnapshotsTest-Group-1450518168: creating
Sep 07 18:00:34 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ff241b14-0f3a-42ae-9b32-a67d2e84bc27 tempest-GroupSnapshotsTest-319184014 None] Group tempest-GroupSnapshotsTest-Group-1450518168: created successfully
Sep 07 18:00:34 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ff241b14-0f3a-42ae-9b32-a67d2e84bc27 tempest-GroupSnapshotsTest-319184014 None] Create group completed successfully.
Sep 07 18:00:36 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:00:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Flow 'volume_create_manager' (6a0f1112-8ff9-4c99-ba57-b917c7181374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:00:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a25abf8a-7073-4295-9ae6-e997d2ef645a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:00:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a25abf8a-7073-4295-9ae6-e997d2ef645a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1538749774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=013418e8-d59e-43d3-8e88-3883bdc34263,host='devstack@QuobyteHD#QuobyteHD',id=ba2217ff-4dac-42a2-a25b-884b7d84879b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e587b279cef4d6d8329519aa853c0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:00:36Z,use_quota=True,user_id='55884fccbae9432aa03f85e4eed4ca39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b112388c-37ef-40f2-b321-0ad56a9f7448),volume_type_id=b112388c-37ef-40f2-b321-0ad56a9f7448)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:00:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da97080-443e-49d6-9849-25f008fece3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:00:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4da97080-443e-49d6-9849-25f008fece3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:00:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9984ac82-51f8-4b21-a3a1-ef513274e4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:00:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9984ac82-51f8-4b21-a3a1-ef513274e4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba2217ff-4dac-42a2-a25b-884b7d84879b', 'volume_name': 'volume-ba2217ff-4dac-42a2-a25b-884b7d84879b', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:00:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20228b7-29fe-4333-98be-151168beccd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:00:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d20228b7-29fe-4333-98be-151168beccd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:00:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e442e60d-0bd5-47ca-bdc0-8c4b7186b3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:00:36 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Volume ba2217ff-4dac-42a2-a25b-884b7d84879b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba2217ff-4dac-42a2-a25b-884b7d84879b', 'volume_size': 1}
Sep 07 18:00:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:00:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:00:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=013418e8-d59e-43d3-8e88-3883bdc34263,created_at=2026-09-07T16:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1538749774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=013418e8-d59e-43d3-8e88-3883bdc34263,host='devstack@QuobyteHD#QuobyteHD',id=ba2217ff-4dac-42a2-a25b-884b7d84879b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e587b279cef4d6d8329519aa853c0c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:00:36Z,use_quota=True,user_id='55884fccbae9432aa03f85e4eed4ca39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b112388c-37ef-40f2-b321-0ad56a9f7448),volume_type_id=b112388c-37ef-40f2-b321-0ad56a9f7448)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:00:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Creating volume ba2217ff-4dac-42a2-a25b-884b7d84879b {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:00:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:00:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:00:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:00:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:00:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:00:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:00:36 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:00:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:36 devstack sudo[89178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b 1073741824
Sep 07 18:00:36 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:36 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b 1073741824" returned: 0 in 0.628s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:37 devstack sudo[89188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b
Sep 07 18:00:37 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:37 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b" returned: 0 in 0.290s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:00:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:00:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e442e60d-0bd5-47ca-bdc0-8c4b7186b3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba2217ff-4dac-42a2-a25b-884b7d84879b', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:00:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28c55f7-93ae-4d9a-b5f4-1d27846c5c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:00:37 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Volume volume-ba2217ff-4dac-42a2-a25b-884b7d84879b (ba2217ff-4dac-42a2-a25b-884b7d84879b): created successfully
Sep 07 18:00:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28c55f7-93ae-4d9a-b5f4-1d27846c5c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:00:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Flow 'volume_create_manager' (6a0f1112-8ff9-4c99-ba57-b917c7181374) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:00:37 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ab59850a-619e-42e1-bb36-75d04f40e990 tempest-GroupSnapshotsTest-319184014 None] Created volume successfully.
Sep 07 18:00:38 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-91c5168b-1082-4891-b23e-8ffe56dc1eba tempest-GroupSnapshotsTest-319184014 None] GroupSnapshot 5e248e20-f8a0-498c-bebd-96ab0cf9a6ff: creating.
Sep 07 18:00:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-91c5168b-1082-4891-b23e-8ffe56dc1eba tempest-GroupSnapshotsTest-319184014 None] Group snapshot 5e248e20-f8a0-498c-bebd-96ab0cf9a6ff: creating. {{(pid=87269) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 07 18:00:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-91c5168b-1082-4891-b23e-8ffe56dc1eba tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:00:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-91c5168b-1082-4891-b23e-8ffe56dc1eba tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:00:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-91c5168b-1082-4891-b23e-8ffe56dc1eba tempest-GroupSnapshotsTest-319184014 None] Creating offline snapshot ff6debf4-4993-4242-bf3a-05fcc6739a50 of volume ba2217ff-4dac-42a2-a25b-884b7d84879b {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:00:38 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b708940e-2322-43b0-9c44-2fa853c1772d]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:00:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-91c5168b-1082-4891-b23e-8ffe56dc1eba tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:38 devstack sudo[89193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b
Sep 07 18:00:38 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:39 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-91c5168b-1082-4891-b23e-8ffe56dc1eba tempest-GroupSnapshotsTest-319184014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b" returned: 0 in 0.453s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-91c5168b-1082-4891-b23e-8ffe56dc1eba tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b.ff6debf4-4993-4242-bf3a-05fcc6739a50 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:39 devstack sudo[89198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b.ff6debf4-4993-4242-bf3a-05fcc6739a50 1G
Sep 07 18:00:39 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:39 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-91c5168b-1082-4891-b23e-8ffe56dc1eba tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b.ff6debf4-4993-4242-bf3a-05fcc6739a50 1G" returned: 0 in 0.607s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-91c5168b-1082-4891-b23e-8ffe56dc1eba tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba2217ff-4dac-42a2-a25b-884b7d84879b -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b.ff6debf4-4993-4242-bf3a-05fcc6739a50 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:39 devstack sudo[89209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba2217ff-4dac-42a2-a25b-884b7d84879b -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b.ff6debf4-4993-4242-bf3a-05fcc6739a50
Sep 07 18:00:39 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:40 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-91c5168b-1082-4891-b23e-8ffe56dc1eba tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba2217ff-4dac-42a2-a25b-884b7d84879b -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b.ff6debf4-4993-4242-bf3a-05fcc6739a50" returned: 0 in 0.372s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:40 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-91c5168b-1082-4891-b23e-8ffe56dc1eba tempest-GroupSnapshotsTest-319184014 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b.ff6debf4-4993-4242-bf3a-05fcc6739a50 is being set with open permissions: ugo+rw: NotImplementedError
Sep 07 18:00:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-91c5168b-1082-4891-b23e-8ffe56dc1eba tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b.ff6debf4-4993-4242-bf3a-05fcc6739a50 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:40 devstack sudo[89215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b.ff6debf4-4993-4242-bf3a-05fcc6739a50
Sep 07 18:00:40 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:40 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-91c5168b-1082-4891-b23e-8ffe56dc1eba tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b.ff6debf4-4993-4242-bf3a-05fcc6739a50" returned: 0 in 0.321s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-91c5168b-1082-4891-b23e-8ffe56dc1eba tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:40 devstack sudo[89221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b.info
Sep 07 18:00:40 devstack sudo[89221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:41 devstack sudo[89221]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-91c5168b-1082-4891-b23e-8ffe56dc1eba tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b.info" returned: 0 in 0.455s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:41 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-91c5168b-1082-4891-b23e-8ffe56dc1eba tempest-GroupSnapshotsTest-319184014 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 07 18:00:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-91c5168b-1082-4891-b23e-8ffe56dc1eba tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:41 devstack sudo[89224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b.info
Sep 07 18:00:41 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:41 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-91c5168b-1082-4891-b23e-8ffe56dc1eba tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b.info" returned: 0 in 0.401s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-91c5168b-1082-4891-b23e-8ffe56dc1eba tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.730s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:00:41 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-91c5168b-1082-4891-b23e-8ffe56dc1eba tempest-GroupSnapshotsTest-319184014 None] group_snapshot 5e248e20-f8a0-498c-bebd-96ab0cf9a6ff: created successfully
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Flow 'volume_create_manager' (80036c80-5888-4ea4-952e-ca4f0febc154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c9b163-a75c-4dac-ba1c-3509d0c910fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c9b163-a75c-4dac-ba1c-3509d0c910fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1650553275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41f52f90b3304febbeee147b2b77661e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:00:42Z,use_quota=True,user_id='0401a3986ef8401ca9ffb43fd9917f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8786bb9b-6853-4a88-9a1a-3e3b236733ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8786bb9b-6853-4a88-9a1a-3e3b236733ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce670c5-6626-4f97-aab6-23c835df5adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce670c5-6626-4f97-aab6-23c835df5adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b', 'volume_name': 'volume-149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438814c5-abeb-411b-be2c-8b3a92d33330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438814c5-abeb-411b-be2c-8b3a92d33330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45325d67-d60e-4ffc-a18b-6b7d83f117dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:00:42 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Volume 149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b', 'volume_size': 1}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:00:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1650553275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41f52f90b3304febbeee147b2b77661e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:00:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:00:42Z,use_quota=True,user_id='0401a3986ef8401ca9ffb43fd9917f2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Creating volume 149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:00:42 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:42 devstack sudo[89238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b 1073741824
Sep 07 18:00:42 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:42 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-cfe21ab2-3f4a-4f9c-b681-4c12a00e0375 tempest-GroupSnapshotsTest-319184014 None] group_snapshot 5e248e20-f8a0-498c-bebd-96ab0cf9a6ff: deleting
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cfe21ab2-3f4a-4f9c-b681-4c12a00e0375 tempest-GroupSnapshotsTest-319184014 None] group_snapshot 5e248e20-f8a0-498c-bebd-96ab0cf9a6ff: deleting {{(pid=87269) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cfe21ab2-3f4a-4f9c-b681-4c12a00e0375 tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "cinder-quobyte-ba2217ff-4dac-42a2-a25b-884b7d84879b" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cfe21ab2-3f4a-4f9c-b681-4c12a00e0375 tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-ba2217ff-4dac-42a2-a25b-884b7d84879b" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cfe21ab2-3f4a-4f9c-b681-4c12a00e0375 tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "cinder-quobyte-ff6debf4-4993-4242-bf3a-05fcc6739a50" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cfe21ab2-3f4a-4f9c-b681-4c12a00e0375 tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-ff6debf4-4993-4242-bf3a-05fcc6739a50" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-cfe21ab2-3f4a-4f9c-b681-4c12a00e0375 tempest-GroupSnapshotsTest-319184014 None] Deleting offline snapshot ff6debf4-4993-4242-bf3a-05fcc6739a50 of volume ba2217ff-4dac-42a2-a25b-884b7d84879b {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-cfe21ab2-3f4a-4f9c-b681-4c12a00e0375 tempest-GroupSnapshotsTest-319184014 None] snapshot_file for this snap is: volume-ba2217ff-4dac-42a2-a25b-884b7d84879b.ff6debf4-4993-4242-bf3a-05fcc6739a50 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a31c19-4326-4865-ae50-84d7f8a4b0ef]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cfe21ab2-3f4a-4f9c-b681-4c12a00e0375 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b.ff6debf4-4993-4242-bf3a-05fcc6739a50 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:42 devstack sudo[89248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b.ff6debf4-4993-4242-bf3a-05fcc6739a50
Sep 07 18:00:42 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:42 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b 1073741824" returned: 0 in 0.728s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:43 devstack sudo[89251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b
Sep 07 18:00:43 devstack sudo[89251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:43 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cfe21ab2-3f4a-4f9c-b681-4c12a00e0375 tempest-GroupSnapshotsTest-319184014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b.ff6debf4-4993-4242-bf3a-05fcc6739a50" returned: 0 in 0.588s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-cfe21ab2-3f4a-4f9c-b681-4c12a00e0375 tempest-GroupSnapshotsTest-319184014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba2217ff-4dac-42a2-a25b-884b7d84879b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:00:43 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e5fb29-6448-4015-9463-48243002b712]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:00:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cfe21ab2-3f4a-4f9c-b681-4c12a00e0375 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:43 devstack sudo[89251]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b" returned: 0 in 0.315s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:00:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:00:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45325d67-d60e-4ffc-a18b-6b7d83f117dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:00:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61b1b68-686b-4fd6-9392-72eae332b771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:00:43 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Volume volume-149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b (149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b): created successfully
Sep 07 18:00:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61b1b68-686b-4fd6-9392-72eae332b771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:00:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Flow 'volume_create_manager' (80036c80-5888-4ea4-952e-ca4f0febc154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:00:43 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-10a26555-d682-4ad0-b403-1e8abcbd2f44 tempest-TaggedAttachmentsTest-457261015 None] Created volume successfully.
Sep 07 18:00:43 devstack sudo[89258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b
Sep 07 18:00:43 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:43 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cfe21ab2-3f4a-4f9c-b681-4c12a00e0375 tempest-GroupSnapshotsTest-319184014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b" returned: 0 in 0.403s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cfe21ab2-3f4a-4f9c-b681-4c12a00e0375 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b.ff6debf4-4993-4242-bf3a-05fcc6739a50 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:43 devstack sudo[89264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b.ff6debf4-4993-4242-bf3a-05fcc6739a50
Sep 07 18:00:43 devstack sudo[89264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:44 devstack sudo[89264]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cfe21ab2-3f4a-4f9c-b681-4c12a00e0375 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b.ff6debf4-4993-4242-bf3a-05fcc6739a50" returned: 0 in 0.460s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cfe21ab2-3f4a-4f9c-b681-4c12a00e0375 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b.ff6debf4-4993-4242-bf3a-05fcc6739a50 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:44 devstack sudo[89272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b.ff6debf4-4993-4242-bf3a-05fcc6739a50
Sep 07 18:00:44 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:44 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cfe21ab2-3f4a-4f9c-b681-4c12a00e0375 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b.ff6debf4-4993-4242-bf3a-05fcc6739a50" returned: 0 in 0.299s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cfe21ab2-3f4a-4f9c-b681-4c12a00e0375 tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-ff6debf4-4993-4242-bf3a-05fcc6739a50" released by "_delete_snapshot" :: held 1.885s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:00:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cfe21ab2-3f4a-4f9c-b681-4c12a00e0375 tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-ba2217ff-4dac-42a2-a25b-884b7d84879b" released by "delete_snapshot" :: held 1.934s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:00:44 devstack cinder-volume[87269]: WARNING cinder.quota [None req-cfe21ab2-3f4a-4f9c-b681-4c12a00e0375 tempest-GroupSnapshotsTest-319184014 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-75585098 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-75585098, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:00:44 devstack cinder-volume[87269]: WARNING cinder.quota [None req-cfe21ab2-3f4a-4f9c-b681-4c12a00e0375 tempest-GroupSnapshotsTest-319184014 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-75585098 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-75585098, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:00:44 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-cfe21ab2-3f4a-4f9c-b681-4c12a00e0375 tempest-GroupSnapshotsTest-319184014 None] Created reservations ['d33763e7-a7dc-4bf9-82a6-ab22be82f6bd', 'afd2deb2-4057-4bfa-a061-759556ad1fc4', '773967a9-7fa1-4f46-818d-7654422e07fe', '6bd90474-0098-4ed4-8789-d7da4ebe3a79'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:00:44 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-cfe21ab2-3f4a-4f9c-b681-4c12a00e0375 tempest-GroupSnapshotsTest-319184014 None] group_snapshot 5e248e20-f8a0-498c-bebd-96ab0cf9a6ff: deleted successfully
Sep 07 18:00:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-92a1f012-3b68-4889-bf1f-175c047e4365 tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "cinder-quobyte-ba2217ff-4dac-42a2-a25b-884b7d84879b" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:00:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-92a1f012-3b68-4889-bf1f-175c047e4365 tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-ba2217ff-4dac-42a2-a25b-884b7d84879b" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:00:45 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f84a31-91db-49c3-9cb1-f7be0895a11c]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:00:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92a1f012-3b68-4889-bf1f-175c047e4365 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:45 devstack sudo[89277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b
Sep 07 18:00:45 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:45 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92a1f012-3b68-4889-bf1f-175c047e4365 tempest-GroupSnapshotsTest-319184014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b" returned: 0 in 0.435s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92a1f012-3b68-4889-bf1f-175c047e4365 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:45 devstack sudo[89283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b
Sep 07 18:00:45 devstack sudo[89283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:46 devstack sudo[89283]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92a1f012-3b68-4889-bf1f-175c047e4365 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ba2217ff-4dac-42a2-a25b-884b7d84879b" returned: 0 in 0.304s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-92a1f012-3b68-4889-bf1f-175c047e4365 tempest-GroupSnapshotsTest-319184014 None] Lock "cinder-quobyte-ba2217ff-4dac-42a2-a25b-884b7d84879b" released by "delete_volume" :: held 0.833s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:00:46 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-92a1f012-3b68-4889-bf1f-175c047e4365 tempest-GroupSnapshotsTest-319184014 None] Created reservations ['2d1883e6-80ee-4ed0-9657-0cf9df8ee959'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:00:46 devstack cinder-volume[87269]: WARNING cinder.quota [None req-92a1f012-3b68-4889-bf1f-175c047e4365 tempest-GroupSnapshotsTest-319184014 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-75585098 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-75585098, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:00:46 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-92a1f012-3b68-4889-bf1f-175c047e4365 tempest-GroupSnapshotsTest-319184014 None] Created reservations ['840f04dd-e270-4015-971d-9fea50170a05', '9aa281c6-5f34-424f-8cb0-165f1d8eccc8', 'db28da85-dfd7-4a14-815e-0ae8306c3421', '1683f497-ba9b-421f-a6e4-b0ff794876ac'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:00:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92a1f012-3b68-4889-bf1f-175c047e4365 tempest-GroupSnapshotsTest-319184014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:00:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92a1f012-3b68-4889-bf1f-175c047e4365 tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:00:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-92a1f012-3b68-4889-bf1f-175c047e4365 tempest-GroupSnapshotsTest-319184014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:00:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-92a1f012-3b68-4889-bf1f-175c047e4365 tempest-GroupSnapshotsTest-319184014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:00:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-92a1f012-3b68-4889-bf1f-175c047e4365 tempest-GroupSnapshotsTest-319184014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:00:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92a1f012-3b68-4889-bf1f-175c047e4365 tempest-GroupSnapshotsTest-319184014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:00:46 devstack sudo[89287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:00:46 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:00:46 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root
Sep 07 18:00:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-92a1f012-3b68-4889-bf1f-175c047e4365 tempest-GroupSnapshotsTest-319184014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.488s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:00:46 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-92a1f012-3b68-4889-bf1f-175c047e4365 tempest-GroupSnapshotsTest-319184014 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:00:46 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-92a1f012-3b68-4889-bf1f-175c047e4365 tempest-GroupSnapshotsTest-319184014 None] Delete group completed successfully.
Sep 07 18:00:56 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=40,cinder:SELECT=39,cinder:INSERT=10 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:00:56 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=39,cinder:UPDATE=50,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:00:58 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-72bc2af9-0175-4b6d-a978-0510a9ca71ef tempest-GroupSnapshotsV319Test-960657966 None] Group tempest-GroupSnapshotsV319Test-Group-1182916: creating
Sep 07 18:00:58 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-72bc2af9-0175-4b6d-a978-0510a9ca71ef tempest-GroupSnapshotsV319Test-960657966 None] Group tempest-GroupSnapshotsV319Test-Group-1182916: created successfully
Sep 07 18:00:58 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-72bc2af9-0175-4b6d-a978-0510a9ca71ef tempest-GroupSnapshotsV319Test-960657966 None] Create group completed successfully.
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Flow 'volume_create_manager' (b4758fb3-a8c4-44fc-b125-a19eb3fd89a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e173ba-1e13-45b5-b8fd-5891f2376f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6e173ba-1e13-45b5-b8fd-5891f2376f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1921813578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=51a43db4-8518-41a9-a2d2-60ee40c30051,host='devstack@QuobyteHD#QuobyteHD',id=00849cf4-9919-46c1-ab5c-2420307650a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648f116e301b452dabbd2d17d733fdc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:01:00Z,use_quota=True,user_id='c35564c50bbe4a07a5ec52a562bbee8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf77a419-f986-44e3-802d-1c3b109c5a41),volume_type_id=cf77a419-f986-44e3-802d-1c3b109c5a41)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac3b5d11-e1f2-454d-893a-362b670ab91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac3b5d11-e1f2-454d-893a-362b670ab91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41fbef29-e607-497a-816a-55cae8e5a278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41fbef29-e607-497a-816a-55cae8e5a278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00849cf4-9919-46c1-ab5c-2420307650a6', 'volume_name': 'volume-00849cf4-9919-46c1-ab5c-2420307650a6', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a54f0d79-eb50-453e-a934-eacaca15dc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a54f0d79-eb50-453e-a934-eacaca15dc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1137ef45-411d-4454-89fe-78b9665ef42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:01:00 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Volume 00849cf4-9919-46c1-ab5c-2420307650a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00849cf4-9919-46c1-ab5c-2420307650a6', 'volume_size': 1}
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=51a43db4-8518-41a9-a2d2-60ee40c30051,created_at=2026-09-07T16:01:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1921813578',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=51a43db4-8518-41a9-a2d2-60ee40c30051,host='devstack@QuobyteHD#QuobyteHD',id=00849cf4-9919-46c1-ab5c-2420307650a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648f116e301b452dabbd2d17d733fdc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:01:00Z,use_quota=True,user_id='c35564c50bbe4a07a5ec52a562bbee8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cf77a419-f986-44e3-802d-1c3b109c5a41),volume_type_id=cf77a419-f986-44e3-802d-1c3b109c5a41)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Creating volume 00849cf4-9919-46c1-ab5c-2420307650a6 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:01:00 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:01:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:00 devstack sudo[89505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6 1073741824
Sep 07 18:01:00 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:00 devstack sudo[89507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:01:00 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:01 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.799s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:01:02 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6 1073741824" returned: 0 in 1.341s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:02 devstack sudo[89550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6
Sep 07 18:01:02 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:02 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6" returned: 0 in 0.463s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] <== create_volume: return (1909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:01:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:01:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1137ef45-411d-4454-89fe-78b9665ef42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00849cf4-9919-46c1-ab5c-2420307650a6', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:01:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a42e6d-79ba-4faf-95f1-bafb817050f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:01:02 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Volume volume-00849cf4-9919-46c1-ab5c-2420307650a6 (00849cf4-9919-46c1-ab5c-2420307650a6): created successfully
Sep 07 18:01:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a42e6d-79ba-4faf-95f1-bafb817050f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:01:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Flow 'volume_create_manager' (b4758fb3-a8c4-44fc-b125-a19eb3fd89a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:01:02 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-84d7925a-bf3c-4519-855d-ccf751a98e62 tempest-GroupSnapshotsV319Test-960657966 None] Created volume successfully.
Sep 07 18:01:03 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a254e12a-02cd-417a-b6dd-4a04a9bac0c1 tempest-GroupSnapshotsV319Test-960657966 None] GroupSnapshot 0828ebaa-3324-4029-8046-24ae065ee39f: creating.
Sep 07 18:01:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a254e12a-02cd-417a-b6dd-4a04a9bac0c1 tempest-GroupSnapshotsV319Test-960657966 None] Group snapshot 0828ebaa-3324-4029-8046-24ae065ee39f: creating. {{(pid=87269) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 07 18:01:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a254e12a-02cd-417a-b6dd-4a04a9bac0c1 tempest-GroupSnapshotsV319Test-960657966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:01:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a254e12a-02cd-417a-b6dd-4a04a9bac0c1 tempest-GroupSnapshotsV319Test-960657966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:01:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a254e12a-02cd-417a-b6dd-4a04a9bac0c1 tempest-GroupSnapshotsV319Test-960657966 None] Creating offline snapshot 1aa0868b-fcfa-498f-bd7c-f9560a7b9cb7 of volume 00849cf4-9919-46c1-ab5c-2420307650a6 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:01:03 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[846a2e6b-9d4c-427e-91ab-67337eb5f555]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:01:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a254e12a-02cd-417a-b6dd-4a04a9bac0c1 tempest-GroupSnapshotsV319Test-960657966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:03 devstack sudo[89553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6
Sep 07 18:01:03 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:04 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a254e12a-02cd-417a-b6dd-4a04a9bac0c1 tempest-GroupSnapshotsV319Test-960657966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6" returned: 0 in 0.526s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a254e12a-02cd-417a-b6dd-4a04a9bac0c1 tempest-GroupSnapshotsV319Test-960657966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6.1aa0868b-fcfa-498f-bd7c-f9560a7b9cb7 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:04 devstack sudo[89562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6.1aa0868b-fcfa-498f-bd7c-f9560a7b9cb7 1G
Sep 07 18:01:04 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:04 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a254e12a-02cd-417a-b6dd-4a04a9bac0c1 tempest-GroupSnapshotsV319Test-960657966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6.1aa0868b-fcfa-498f-bd7c-f9560a7b9cb7 1G" returned: 0 in 0.650s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a254e12a-02cd-417a-b6dd-4a04a9bac0c1 tempest-GroupSnapshotsV319Test-960657966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00849cf4-9919-46c1-ab5c-2420307650a6 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6.1aa0868b-fcfa-498f-bd7c-f9560a7b9cb7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:04 devstack sudo[89581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00849cf4-9919-46c1-ab5c-2420307650a6 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6.1aa0868b-fcfa-498f-bd7c-f9560a7b9cb7
Sep 07 18:01:04 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:05 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a254e12a-02cd-417a-b6dd-4a04a9bac0c1 tempest-GroupSnapshotsV319Test-960657966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00849cf4-9919-46c1-ab5c-2420307650a6 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6.1aa0868b-fcfa-498f-bd7c-f9560a7b9cb7" returned: 0 in 0.707s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:05 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-a254e12a-02cd-417a-b6dd-4a04a9bac0c1 tempest-GroupSnapshotsV319Test-960657966 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6.1aa0868b-fcfa-498f-bd7c-f9560a7b9cb7 is being set with open permissions: ugo+rw: NotImplementedError
Sep 07 18:01:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a254e12a-02cd-417a-b6dd-4a04a9bac0c1 tempest-GroupSnapshotsV319Test-960657966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6.1aa0868b-fcfa-498f-bd7c-f9560a7b9cb7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:05 devstack sudo[89630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6.1aa0868b-fcfa-498f-bd7c-f9560a7b9cb7
Sep 07 18:01:05 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:06 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a254e12a-02cd-417a-b6dd-4a04a9bac0c1 tempest-GroupSnapshotsV319Test-960657966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6.1aa0868b-fcfa-498f-bd7c-f9560a7b9cb7" returned: 0 in 0.586s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a254e12a-02cd-417a-b6dd-4a04a9bac0c1 tempest-GroupSnapshotsV319Test-960657966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:06 devstack sudo[89645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6.info
Sep 07 18:01:06 devstack sudo[89645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:06 devstack sudo[89645]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a254e12a-02cd-417a-b6dd-4a04a9bac0c1 tempest-GroupSnapshotsV319Test-960657966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6.info" returned: 0 in 0.306s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:06 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-a254e12a-02cd-417a-b6dd-4a04a9bac0c1 tempest-GroupSnapshotsV319Test-960657966 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 07 18:01:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a254e12a-02cd-417a-b6dd-4a04a9bac0c1 tempest-GroupSnapshotsV319Test-960657966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:06 devstack sudo[89650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6.info
Sep 07 18:01:06 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:06 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a254e12a-02cd-417a-b6dd-4a04a9bac0c1 tempest-GroupSnapshotsV319Test-960657966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6.info" returned: 0 in 0.264s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a254e12a-02cd-417a-b6dd-4a04a9bac0c1 tempest-GroupSnapshotsV319Test-960657966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.191s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:01:07 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a254e12a-02cd-417a-b6dd-4a04a9bac0c1 tempest-GroupSnapshotsV319Test-960657966 None] group_snapshot 0828ebaa-3324-4029-8046-24ae065ee39f: created successfully
Sep 07 18:01:07 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4e2abcaa-795f-47ff-b174-aeb3ec8f88ac tempest-GroupSnapshotsV319Test-960657966 None] group_snapshot 0828ebaa-3324-4029-8046-24ae065ee39f: deleting
Sep 07 18:01:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4e2abcaa-795f-47ff-b174-aeb3ec8f88ac tempest-GroupSnapshotsV319Test-960657966 None] group_snapshot 0828ebaa-3324-4029-8046-24ae065ee39f: deleting {{(pid=87269) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 07 18:01:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4e2abcaa-795f-47ff-b174-aeb3ec8f88ac tempest-GroupSnapshotsV319Test-960657966 None] Acquiring lock "cinder-quobyte-00849cf4-9919-46c1-ab5c-2420307650a6" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:01:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4e2abcaa-795f-47ff-b174-aeb3ec8f88ac tempest-GroupSnapshotsV319Test-960657966 None] Lock "cinder-quobyte-00849cf4-9919-46c1-ab5c-2420307650a6" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:01:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4e2abcaa-795f-47ff-b174-aeb3ec8f88ac tempest-GroupSnapshotsV319Test-960657966 None] Acquiring lock "cinder-quobyte-1aa0868b-fcfa-498f-bd7c-f9560a7b9cb7" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:01:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4e2abcaa-795f-47ff-b174-aeb3ec8f88ac tempest-GroupSnapshotsV319Test-960657966 None] Lock "cinder-quobyte-1aa0868b-fcfa-498f-bd7c-f9560a7b9cb7" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:01:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4e2abcaa-795f-47ff-b174-aeb3ec8f88ac tempest-GroupSnapshotsV319Test-960657966 None] Deleting offline snapshot 1aa0868b-fcfa-498f-bd7c-f9560a7b9cb7 of volume 00849cf4-9919-46c1-ab5c-2420307650a6 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:01:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4e2abcaa-795f-47ff-b174-aeb3ec8f88ac tempest-GroupSnapshotsV319Test-960657966 None] snapshot_file for this snap is: volume-00849cf4-9919-46c1-ab5c-2420307650a6.1aa0868b-fcfa-498f-bd7c-f9560a7b9cb7 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:01:07 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[366421fc-5eb2-431f-b12c-19b4b8b58856]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:01:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4e2abcaa-795f-47ff-b174-aeb3ec8f88ac tempest-GroupSnapshotsV319Test-960657966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6.1aa0868b-fcfa-498f-bd7c-f9560a7b9cb7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:07 devstack sudo[89655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6.1aa0868b-fcfa-498f-bd7c-f9560a7b9cb7
Sep 07 18:01:07 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:08 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4e2abcaa-795f-47ff-b174-aeb3ec8f88ac tempest-GroupSnapshotsV319Test-960657966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6.1aa0868b-fcfa-498f-bd7c-f9560a7b9cb7" returned: 0 in 0.423s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4e2abcaa-795f-47ff-b174-aeb3ec8f88ac tempest-GroupSnapshotsV319Test-960657966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00849cf4-9919-46c1-ab5c-2420307650a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:01:08 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5738b30e-d616-48d9-8422-9839a64088ec]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:01:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4e2abcaa-795f-47ff-b174-aeb3ec8f88ac tempest-GroupSnapshotsV319Test-960657966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:08 devstack sudo[89660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6
Sep 07 18:01:08 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:08 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4e2abcaa-795f-47ff-b174-aeb3ec8f88ac tempest-GroupSnapshotsV319Test-960657966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6" returned: 0 in 0.505s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4e2abcaa-795f-47ff-b174-aeb3ec8f88ac tempest-GroupSnapshotsV319Test-960657966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6.1aa0868b-fcfa-498f-bd7c-f9560a7b9cb7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:08 devstack sudo[89666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6.1aa0868b-fcfa-498f-bd7c-f9560a7b9cb7
Sep 07 18:01:08 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:09 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4e2abcaa-795f-47ff-b174-aeb3ec8f88ac tempest-GroupSnapshotsV319Test-960657966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6.1aa0868b-fcfa-498f-bd7c-f9560a7b9cb7" returned: 0 in 0.474s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4e2abcaa-795f-47ff-b174-aeb3ec8f88ac tempest-GroupSnapshotsV319Test-960657966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6.1aa0868b-fcfa-498f-bd7c-f9560a7b9cb7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:09 devstack sudo[89671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6.1aa0868b-fcfa-498f-bd7c-f9560a7b9cb7
Sep 07 18:01:09 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:09 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4e2abcaa-795f-47ff-b174-aeb3ec8f88ac tempest-GroupSnapshotsV319Test-960657966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6.1aa0868b-fcfa-498f-bd7c-f9560a7b9cb7" returned: 0 in 0.344s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4e2abcaa-795f-47ff-b174-aeb3ec8f88ac tempest-GroupSnapshotsV319Test-960657966 None] Lock "cinder-quobyte-1aa0868b-fcfa-498f-bd7c-f9560a7b9cb7" released by "_delete_snapshot" :: held 1.877s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:01:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4e2abcaa-795f-47ff-b174-aeb3ec8f88ac tempest-GroupSnapshotsV319Test-960657966 None] Lock "cinder-quobyte-00849cf4-9919-46c1-ab5c-2420307650a6" released by "delete_snapshot" :: held 1.912s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:01:09 devstack cinder-volume[87269]: WARNING cinder.quota [None req-4e2abcaa-795f-47ff-b174-aeb3ec8f88ac tempest-GroupSnapshotsV319Test-960657966 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2096823226 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2096823226, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:01:09 devstack cinder-volume[87269]: WARNING cinder.quota [None req-4e2abcaa-795f-47ff-b174-aeb3ec8f88ac tempest-GroupSnapshotsV319Test-960657966 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2096823226 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2096823226, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:01:09 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-4e2abcaa-795f-47ff-b174-aeb3ec8f88ac tempest-GroupSnapshotsV319Test-960657966 None] Created reservations ['f767a454-fe36-402f-8984-29f2683a7456', '5e1e59cf-ea3e-456f-9fd5-5e16b562a5f7', '10f15a4a-5f66-4ef8-9bc4-fb5800b770e4', '7de44fe2-8589-435a-a8bb-82afb8ac5bf8'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:01:09 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4e2abcaa-795f-47ff-b174-aeb3ec8f88ac tempest-GroupSnapshotsV319Test-960657966 None] group_snapshot 0828ebaa-3324-4029-8046-24ae065ee39f: deleted successfully
Sep 07 18:01:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-846ba095-27ff-4b9d-b8fb-96ef1988daad tempest-GroupSnapshotsV319Test-960657966 None] Acquiring lock "cinder-quobyte-00849cf4-9919-46c1-ab5c-2420307650a6" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:01:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-846ba095-27ff-4b9d-b8fb-96ef1988daad tempest-GroupSnapshotsV319Test-960657966 None] Lock "cinder-quobyte-00849cf4-9919-46c1-ab5c-2420307650a6" acquired by "delete_volume" :: waited 0.034s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:01:10 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e385a955-8a12-4f45-9b8f-ed13cc0f3cd2]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:01:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-846ba095-27ff-4b9d-b8fb-96ef1988daad tempest-GroupSnapshotsV319Test-960657966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:10 devstack sudo[89677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6
Sep 07 18:01:10 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:11 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-846ba095-27ff-4b9d-b8fb-96ef1988daad tempest-GroupSnapshotsV319Test-960657966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6" returned: 0 in 0.627s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-846ba095-27ff-4b9d-b8fb-96ef1988daad tempest-GroupSnapshotsV319Test-960657966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:11 devstack sudo[89682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6
Sep 07 18:01:11 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:11 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-846ba095-27ff-4b9d-b8fb-96ef1988daad tempest-GroupSnapshotsV319Test-960657966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00849cf4-9919-46c1-ab5c-2420307650a6" returned: 0 in 0.315s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-846ba095-27ff-4b9d-b8fb-96ef1988daad tempest-GroupSnapshotsV319Test-960657966 None] Lock "cinder-quobyte-00849cf4-9919-46c1-ab5c-2420307650a6" released by "delete_volume" :: held 1.058s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:01:11 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-846ba095-27ff-4b9d-b8fb-96ef1988daad tempest-GroupSnapshotsV319Test-960657966 None] Created reservations ['211a2ca5-a41a-4119-be21-a8ef889fdc5d'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:01:11 devstack cinder-volume[87269]: WARNING cinder.quota [None req-846ba095-27ff-4b9d-b8fb-96ef1988daad tempest-GroupSnapshotsV319Test-960657966 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2096823226 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2096823226, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:01:11 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-846ba095-27ff-4b9d-b8fb-96ef1988daad tempest-GroupSnapshotsV319Test-960657966 None] Created reservations ['f36c240c-aae9-4d85-b1fb-f630f207dbf6', '9d31ef26-e89b-4337-b8f1-70055095f013', '23534f44-a8e2-4419-82f3-ebacb1e48e0c', 'bc98adfe-24fd-4d1b-be0c-9119e81cfb1f'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:01:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-846ba095-27ff-4b9d-b8fb-96ef1988daad tempest-GroupSnapshotsV319Test-960657966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:01:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-846ba095-27ff-4b9d-b8fb-96ef1988daad tempest-GroupSnapshotsV319Test-960657966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:01:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-846ba095-27ff-4b9d-b8fb-96ef1988daad tempest-GroupSnapshotsV319Test-960657966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:01:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-846ba095-27ff-4b9d-b8fb-96ef1988daad tempest-GroupSnapshotsV319Test-960657966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:01:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-846ba095-27ff-4b9d-b8fb-96ef1988daad tempest-GroupSnapshotsV319Test-960657966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:01:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-846ba095-27ff-4b9d-b8fb-96ef1988daad tempest-GroupSnapshotsV319Test-960657966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:12 devstack sudo[89685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:01:12 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:12 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-846ba095-27ff-4b9d-b8fb-96ef1988daad tempest-GroupSnapshotsV319Test-960657966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.383s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:12 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-846ba095-27ff-4b9d-b8fb-96ef1988daad tempest-GroupSnapshotsV319Test-960657966 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:01:12 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-846ba095-27ff-4b9d-b8fb-96ef1988daad tempest-GroupSnapshotsV319Test-960657966 None] Delete group completed successfully.
Sep 07 18:01:14 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:01:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Flow 'volume_create_manager' (06586af8-1389-4b42-ad34-4e1dfd330998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:01:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b180fd25-03ac-494f-9683-993dc81e3cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:01:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b180fd25-03ac-494f-9683-993dc81e3cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2039829659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a1524b6-27dd-40fa-8947-52fbbd86d0f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d983662e8e2435fa7517649a77d917b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:01:14Z,use_quota=True,user_id='4ed1b1bda6f34894b9b648f5320b0495',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:01:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df49fe4-78fb-4894-9e67-ac43f27b63d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:01:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df49fe4-78fb-4894-9e67-ac43f27b63d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:01:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb92a523-7202-4412-8706-a34403935cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:01:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb92a523-7202-4412-8706-a34403935cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a1524b6-27dd-40fa-8947-52fbbd86d0f6', 'volume_name': 'volume-2a1524b6-27dd-40fa-8947-52fbbd86d0f6', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:01:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9726e645-3aa1-44be-95f5-f616cbb48b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:01:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9726e645-3aa1-44be-95f5-f616cbb48b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:01:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d34a39b6-a9c9-47e8-b5e5-abef06dcbc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:01:14 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Volume 2a1524b6-27dd-40fa-8947-52fbbd86d0f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a1524b6-27dd-40fa-8947-52fbbd86d0f6', 'volume_size': 1}
Sep 07 18:01:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:01:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:01:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2039829659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a1524b6-27dd-40fa-8947-52fbbd86d0f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d983662e8e2435fa7517649a77d917b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:01:14Z,use_quota=True,user_id='4ed1b1bda6f34894b9b648f5320b0495',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:01:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Creating volume 2a1524b6-27dd-40fa-8947-52fbbd86d0f6 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:01:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:01:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:01:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:01:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:01:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:01:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:01:14 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:01:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a1524b6-27dd-40fa-8947-52fbbd86d0f6 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:14 devstack sudo[89712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a1524b6-27dd-40fa-8947-52fbbd86d0f6 1073741824
Sep 07 18:01:14 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:15 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a1524b6-27dd-40fa-8947-52fbbd86d0f6 1073741824" returned: 0 in 0.506s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a1524b6-27dd-40fa-8947-52fbbd86d0f6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:15 devstack sudo[89718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a1524b6-27dd-40fa-8947-52fbbd86d0f6
Sep 07 18:01:15 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:15 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a1524b6-27dd-40fa-8947-52fbbd86d0f6" returned: 0 in 0.341s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:01:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:01:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d34a39b6-a9c9-47e8-b5e5-abef06dcbc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a1524b6-27dd-40fa-8947-52fbbd86d0f6', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:01:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77384a3-a2ab-4a24-a901-a7d383c06323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:01:15 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Volume volume-2a1524b6-27dd-40fa-8947-52fbbd86d0f6 (2a1524b6-27dd-40fa-8947-52fbbd86d0f6): created successfully
Sep 07 18:01:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77384a3-a2ab-4a24-a901-a7d383c06323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:01:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Flow 'volume_create_manager' (06586af8-1389-4b42-ad34-4e1dfd330998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:01:15 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-45bfc845-fadd-49a6-a049-8a6537248c2c tempest-AttachVolumeShelveTestJSON-814281689 None] Created volume successfully.
Sep 07 18:01:25 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=27,cinder:INSERT=8,cinder:UPDATE=23 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:01:25 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=26,cinder:UPDATE=29,cinder:DELETE=2,cinder:INSERT=4 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:01:26 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f992b2c6-c7a2-43e5-8fde-c01d861b3cba tempest-GroupsV314Test-86166686 None] Group tempest-GroupsV314Test-Group-1631147049: creating
Sep 07 18:01:26 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f992b2c6-c7a2-43e5-8fde-c01d861b3cba tempest-GroupsV314Test-86166686 None] Group tempest-GroupsV314Test-Group-1631147049: created successfully
Sep 07 18:01:26 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f992b2c6-c7a2-43e5-8fde-c01d861b3cba tempest-GroupsV314Test-86166686 None] Create group completed successfully.
Sep 07 18:01:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-7c0a9589-4a2e-4151-a498-2a8c9ec07dad req-3e9db457-247a-402c-86b3-e55cf4307f19 tempest-AttachVolumeShelveTestJSON-814281689 None] No connector for attachment af5dc3c0-8568-45cd-91c5-2b507bbaa241; skipping storage backend terminate_connection call. {{(pid=87269) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Sep 07 18:01:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-7c0a9589-4a2e-4151-a498-2a8c9ec07dad req-3e9db457-247a-402c-86b3-e55cf4307f19 tempest-AttachVolumeShelveTestJSON-814281689 None] Deleting attachment af5dc3c0-8568-45cd-91c5-2b507bbaa241. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 07 18:01:28 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:01:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Flow 'volume_create_manager' (ad1bb45d-6c79-49bf-a607-02688cada04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:01:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51b2c58-fdc3-4467-93e5-b2f748c19391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:01:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c51b2c58-fdc3-4467-93e5-b2f748c19391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1100826428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0091c8a5-caaa-4911-8bbf-318660c0a59e,host='devstack@QuobyteHD#QuobyteHD',id=9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440b459008ce4d559830163df7b73b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:01:29Z,use_quota=True,user_id='aba7debac1524ca8a683ec23e3d6f82b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0491322-c532-492f-848e-8da314fe267f),volume_type_id=b0491322-c532-492f-848e-8da314fe267f)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:01:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8139c287-c6ce-4d4d-ab27-c5f94d62d7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:01:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8139c287-c6ce-4d4d-ab27-c5f94d62d7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:01:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f0450de-f08a-4f2d-819d-232740fc651c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:01:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f0450de-f08a-4f2d-819d-232740fc651c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1', 'volume_name': 'volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:01:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7878d5-bd26-46a8-8156-b74531976d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:01:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a7878d5-bd26-46a8-8156-b74531976d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:01:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0dc836d-bab6-44a6-9142-d42337addd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:01:28 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Volume 9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1', 'volume_size': 1}
Sep 07 18:01:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:01:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:01:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0091c8a5-caaa-4911-8bbf-318660c0a59e,created_at=2026-09-07T16:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1100826428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0091c8a5-caaa-4911-8bbf-318660c0a59e,host='devstack@QuobyteHD#QuobyteHD',id=9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='440b459008ce4d559830163df7b73b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:01:29Z,use_quota=True,user_id='aba7debac1524ca8a683ec23e3d6f82b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b0491322-c532-492f-848e-8da314fe267f),volume_type_id=b0491322-c532-492f-848e-8da314fe267f)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:01:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Creating volume 9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:01:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:01:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:01:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:01:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:01:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:01:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:01:28 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:01:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:28 devstack sudo[89837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1 1073741824
Sep 07 18:01:28 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:29 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1 1073741824" returned: 0 in 0.691s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:29 devstack sudo[89854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1
Sep 07 18:01:29 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:29 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1" returned: 0 in 0.321s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:01:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:01:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0dc836d-bab6-44a6-9142-d42337addd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:01:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624c142c-af21-44fc-9c8f-6dee7754c14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:01:29 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Volume volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1 (9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1): created successfully
Sep 07 18:01:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624c142c-af21-44fc-9c8f-6dee7754c14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:01:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Flow 'volume_create_manager' (ad1bb45d-6c79-49bf-a607-02688cada04f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:01:30 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-816cfef3-2918-4323-882a-903e3d1baa5f tempest-GroupsV314Test-86166686 None] Created volume successfully.
Sep 07 18:01:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-6a13f940-9822-4371-b3fc-13a011011a1c req-0a55bd6e-99c3-4109-b6c7-bb43fab96263 tempest-TaggedAttachmentsTest-457261015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:01:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-6a13f940-9822-4371-b3fc-13a011011a1c req-0a55bd6e-99c3-4109-b6c7-bb43fab96263 tempest-TaggedAttachmentsTest-457261015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:01:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-6a13f940-9822-4371-b3fc-13a011011a1c req-0a55bd6e-99c3-4109-b6c7-bb43fab96263 tempest-TaggedAttachmentsTest-457261015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:01:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-6a13f940-9822-4371-b3fc-13a011011a1c req-0a55bd6e-99c3-4109-b6c7-bb43fab96263 tempest-TaggedAttachmentsTest-457261015 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d', 'name': 'volume-149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc23f4fe-8c01-41fc-b9d0-ffda7e28b3fa', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 07 18:01:30 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-6a13f940-9822-4371-b3fc-13a011011a1c req-0a55bd6e-99c3-4109-b6c7-bb43fab96263 tempest-TaggedAttachmentsTest-457261015 None] attachment_update completed successfully.
Sep 07 18:01:31 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:01:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Flow 'volume_create_manager' (272432f3-5b92-4805-9d0f-d0756b653c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:01:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6cf8c58-6c8c-4be3-a505-bab9b8ba6683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:01:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6cf8c58-6c8c-4be3-a505-bab9b8ba6683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-444011287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aadee00d-d9cf-4485-af34-b998995255a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80c182c250804a089f6927e435263758',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:01:31Z,use_quota=True,user_id='2da1dfa9a9f542efa5fca89596934fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:01:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3b017e-7ca7-4db4-addc-87deafd4ecd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:01:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3b017e-7ca7-4db4-addc-87deafd4ecd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:01:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1d2134-78ac-4851-b7fc-1f8c2d8d79a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:01:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1d2134-78ac-4851-b7fc-1f8c2d8d79a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aadee00d-d9cf-4485-af34-b998995255a4', 'volume_name': 'volume-aadee00d-d9cf-4485-af34-b998995255a4', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:01:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adde35d1-dd45-4ab1-af73-df5a0981306e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:01:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adde35d1-dd45-4ab1-af73-df5a0981306e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:01:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c6bdcb-07fe-4fc6-b0b4-5e40fc90daac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:01:31 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Volume aadee00d-d9cf-4485-af34-b998995255a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aadee00d-d9cf-4485-af34-b998995255a4', 'volume_size': 1}
Sep 07 18:01:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:01:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:01:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-444011287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aadee00d-d9cf-4485-af34-b998995255a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80c182c250804a089f6927e435263758',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:01:31Z,use_quota=True,user_id='2da1dfa9a9f542efa5fca89596934fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:01:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Creating volume aadee00d-d9cf-4485-af34-b998995255a4 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:01:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:01:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:01:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:01:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:01:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:01:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:01:31 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:01:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aadee00d-d9cf-4485-af34-b998995255a4 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:31 devstack sudo[90254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aadee00d-d9cf-4485-af34-b998995255a4 1073741824
Sep 07 18:01:31 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:01:32 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aadee00d-d9cf-4485-af34-b998995255a4 1073741824" returned: 0 in 0.743s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aadee00d-d9cf-4485-af34-b998995255a4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:32 devstack sudo[90261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aadee00d-d9cf-4485-af34-b998995255a4
Sep 07 18:01:32 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:32 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aadee00d-d9cf-4485-af34-b998995255a4" returned: 0 in 0.367s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:01:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:01:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.470s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:01:32 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Cloning volume 9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1 to volume a1cbcee6-56d0-4744-a9ef-03e65fc81e72
Sep 07 18:01:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c6bdcb-07fe-4fc6-b0b4-5e40fc90daac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aadee00d-d9cf-4485-af34-b998995255a4', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:01:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3dfaba-96cb-4e80-9661-b0c7417efe2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:01:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Creating offline snapshot 6a930a55-ae79-4c11-81d7-bafd21165b6e of volume 9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:01:32 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Volume volume-aadee00d-d9cf-4485-af34-b998995255a4 (aadee00d-d9cf-4485-af34-b998995255a4): created successfully
Sep 07 18:01:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af3dfaba-96cb-4e80-9661-b0c7417efe2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:01:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Flow 'volume_create_manager' (272432f3-5b92-4805-9d0f-d0756b653c88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:01:32 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1e4bf3-bcc5-4d90-b63e-9d302a7ff1d4]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:01:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:32 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-94b1a5d7-029e-4cf1-91ef-e2c4cc76b96e tempest-ServerActionsTestOtherA-1043843369 None] Created volume successfully.
Sep 07 18:01:33 devstack sudo[90268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1
Sep 07 18:01:33 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:33 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1" returned: 0 in 0.493s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.6a930a55-ae79-4c11-81d7-bafd21165b6e 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:33 devstack sudo[90277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.6a930a55-ae79-4c11-81d7-bafd21165b6e 1G
Sep 07 18:01:33 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:34 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.6a930a55-ae79-4c11-81d7-bafd21165b6e 1G" returned: 0 in 0.647s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.6a930a55-ae79-4c11-81d7-bafd21165b6e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:34 devstack sudo[90312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.6a930a55-ae79-4c11-81d7-bafd21165b6e
Sep 07 18:01:34 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:34 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-47d8a31c-eb3e-47cc-a40e-fb757c2a435d req-c1d57f3b-b0b8-4a2e-88f6-2797972503cd tempest-TaggedAttachmentsTest-457261015 None] Terminate volume connection completed successfully.
Sep 07 18:01:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-47d8a31c-eb3e-47cc-a40e-fb757c2a435d req-c1d57f3b-b0b8-4a2e-88f6-2797972503cd tempest-TaggedAttachmentsTest-457261015 None] Deleting attachment cc23f4fe-8c01-41fc-b9d0-ffda7e28b3fa. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 07 18:01:34 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.6a930a55-ae79-4c11-81d7-bafd21165b6e" returned: 0 in 0.459s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:34 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.6a930a55-ae79-4c11-81d7-bafd21165b6e is being set with open permissions: ugo+rw: NotImplementedError
Sep 07 18:01:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.6a930a55-ae79-4c11-81d7-bafd21165b6e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:34 devstack sudo[90318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.6a930a55-ae79-4c11-81d7-bafd21165b6e
Sep 07 18:01:34 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:34 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.6a930a55-ae79-4c11-81d7-bafd21165b6e" returned: 0 in 0.289s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:34 devstack sudo[90321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.info
Sep 07 18:01:34 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.info" returned: 0 in 0.411s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:35 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 07 18:01:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:35 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:35 devstack sudo[90333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.info
Sep 07 18:01:35 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:35 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.info" returned: 0 in 0.486s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Acquiring lock "cinder-quobyte-a1cbcee6-56d0-4744-a9ef-03e65fc81e72" by "_copy_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:01:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Lock "cinder-quobyte-a1cbcee6-56d0-4744-a9ef-03e65fc81e72" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:01:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] snapshot: 6a930a55-ae79-4c11-81d7-bafd21165b6e, volume: a1cbcee6-56d0-4744-a9ef-03e65fc81e72,  {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 07 18:01:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:01:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:01:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:01:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:01:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:01:35 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da27b40-5acc-42ff-8735-f653cd5b0130]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:01:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.6a930a55-ae79-4c11-81d7-bafd21165b6e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:36 devstack sudo[90350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.6a930a55-ae79-4c11-81d7-bafd21165b6e
Sep 07 18:01:36 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:36 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.6a930a55-ae79-4c11-81d7-bafd21165b6e" returned: 0 in 0.621s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:01:36 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[598ce453-5468-474a-bd62-9c2b0f0697a2]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:01:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:36 devstack sudo[90356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1
Sep 07 18:01:36 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:37 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1" returned: 0 in 0.520s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] will copy from snapshot at /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1 {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 07 18:01:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Creating direct copy from snapshot {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 07 18:01:37 devstack cinder-volume[87269]: DEBUG cinder.utils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Path /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a1cbcee6-56d0-4744-a9ef-03e65fc81e72 not found in is_blk_device check {{(pid=87269) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 07 18:01:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a1cbcee6-56d0-4744-a9ef-03e65fc81e72 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:37 devstack sudo[90375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a1cbcee6-56d0-4744-a9ef-03e65fc81e72
Sep 07 18:01:37 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:44 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=18,cinder:UPDATE=10,cinder:INSERT=1 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:01:44 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=21,cinder:UPDATE=8,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:01:45 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a1cbcee6-56d0-4744-a9ef-03e65fc81e72" returned: 0 in 8.169s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:45 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Image conversion details: src /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1, size 1024.00 MB, duration 8.17 sec, destination /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a1cbcee6-56d0-4744-a9ef-03e65fc81e72 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 07 18:01:45 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Converted 1024.00 MB image at 125.30 MB/s
Sep 07 18:01:45 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a1cbcee6-56d0-4744-a9ef-03e65fc81e72 is being set with open permissions: ugo+rw: NotImplementedError
Sep 07 18:01:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a1cbcee6-56d0-4744-a9ef-03e65fc81e72 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:45 devstack sudo[90535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a1cbcee6-56d0-4744-a9ef-03e65fc81e72
Sep 07 18:01:45 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:45 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a1cbcee6-56d0-4744-a9ef-03e65fc81e72" returned: 0 in 0.344s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Lock "cinder-quobyte-a1cbcee6-56d0-4744-a9ef-03e65fc81e72" released by "_copy_volume_from_snapshot" :: held 9.777s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:01:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Acquiring lock "cinder-quobyte-6a930a55-ae79-4c11-81d7-bafd21165b6e" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:01:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Lock "cinder-quobyte-6a930a55-ae79-4c11-81d7-bafd21165b6e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:01:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Deleting offline snapshot 6a930a55-ae79-4c11-81d7-bafd21165b6e of volume 9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:01:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] snapshot_file for this snap is: volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.6a930a55-ae79-4c11-81d7-bafd21165b6e {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:01:45 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[864ae425-9433-46f9-93ac-3e7f4fc26d4e]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:01:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.6a930a55-ae79-4c11-81d7-bafd21165b6e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:45 devstack sudo[90544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.6a930a55-ae79-4c11-81d7-bafd21165b6e
Sep 07 18:01:45 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:46 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.6a930a55-ae79-4c11-81d7-bafd21165b6e" returned: 0 in 0.480s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:01:46 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf583f0-c089-4fb5-be89-c3ea7d80d839]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:01:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:46 devstack sudo[90550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1
Sep 07 18:01:46 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:47 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1" returned: 0 in 0.960s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.6a930a55-ae79-4c11-81d7-bafd21165b6e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:47 devstack sudo[90562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.6a930a55-ae79-4c11-81d7-bafd21165b6e
Sep 07 18:01:47 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:48 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.6a930a55-ae79-4c11-81d7-bafd21165b6e" returned: 0 in 1.045s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.6a930a55-ae79-4c11-81d7-bafd21165b6e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:48 devstack sudo[90589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.6a930a55-ae79-4c11-81d7-bafd21165b6e
Sep 07 18:01:48 devstack sudo[90589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:48 devstack sudo[90589]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1.6a930a55-ae79-4c11-81d7-bafd21165b6e" returned: 0 in 0.764s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Lock "cinder-quobyte-6a930a55-ae79-4c11-81d7-bafd21165b6e" released by "_delete_snapshot" :: held 3.402s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:01:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.314s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:01:49 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e7522794-1ecf-4bb1-bbab-38bae97e9b45 tempest-GroupsV314Test-86166686 None] Create group from source-group-0091c8a5-caaa-4911-8bbf-318660c0a59e completed successfully.
Sep 07 18:01:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-37b219cc-a81e-48c9-90ab-52c6e71fa6fb tempest-GroupsV314Test-86166686 None] Acquiring lock "cinder-quobyte-a1cbcee6-56d0-4744-a9ef-03e65fc81e72" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:01:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-37b219cc-a81e-48c9-90ab-52c6e71fa6fb tempest-GroupsV314Test-86166686 None] Lock "cinder-quobyte-a1cbcee6-56d0-4744-a9ef-03e65fc81e72" acquired by "delete_volume" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:01:50 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d7609e-6f26-4730-8828-87aea318afbb]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:01:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-37b219cc-a81e-48c9-90ab-52c6e71fa6fb tempest-GroupsV314Test-86166686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a1cbcee6-56d0-4744-a9ef-03e65fc81e72 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:50 devstack sudo[90617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a1cbcee6-56d0-4744-a9ef-03e65fc81e72
Sep 07 18:01:50 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:51 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-37b219cc-a81e-48c9-90ab-52c6e71fa6fb tempest-GroupsV314Test-86166686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a1cbcee6-56d0-4744-a9ef-03e65fc81e72" returned: 0 in 0.558s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-37b219cc-a81e-48c9-90ab-52c6e71fa6fb tempest-GroupsV314Test-86166686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a1cbcee6-56d0-4744-a9ef-03e65fc81e72 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:51 devstack sudo[90625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a1cbcee6-56d0-4744-a9ef-03e65fc81e72
Sep 07 18:01:51 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:51 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-37b219cc-a81e-48c9-90ab-52c6e71fa6fb tempest-GroupsV314Test-86166686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a1cbcee6-56d0-4744-a9ef-03e65fc81e72" returned: 0 in 0.525s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-37b219cc-a81e-48c9-90ab-52c6e71fa6fb tempest-GroupsV314Test-86166686 None] Lock "cinder-quobyte-a1cbcee6-56d0-4744-a9ef-03e65fc81e72" released by "delete_volume" :: held 1.172s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:01:51 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-37b219cc-a81e-48c9-90ab-52c6e71fa6fb tempest-GroupsV314Test-86166686 None] Created reservations ['f7781804-2413-4a12-9eb6-7cabadc688bc'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:01:51 devstack cinder-volume[87269]: WARNING cinder.quota [None req-37b219cc-a81e-48c9-90ab-52c6e71fa6fb tempest-GroupsV314Test-86166686 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-312733416 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-312733416, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:01:51 devstack cinder-volume[87269]: WARNING cinder.quota [None req-37b219cc-a81e-48c9-90ab-52c6e71fa6fb tempest-GroupsV314Test-86166686 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-312733416 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-312733416, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:01:51 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-37b219cc-a81e-48c9-90ab-52c6e71fa6fb tempest-GroupsV314Test-86166686 None] Created reservations ['bfc55f59-e433-491c-86a3-3196a2abad9a', '228477f8-7f5e-4f0a-af54-59f9d223945a', '35cd0993-002c-40e7-8b75-3c1e0be0781e', '596a7af4-b2bf-4f0e-9401-eb0945e52b2e'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:01:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-37b219cc-a81e-48c9-90ab-52c6e71fa6fb tempest-GroupsV314Test-86166686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:01:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-37b219cc-a81e-48c9-90ab-52c6e71fa6fb tempest-GroupsV314Test-86166686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:01:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-37b219cc-a81e-48c9-90ab-52c6e71fa6fb tempest-GroupsV314Test-86166686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:01:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-37b219cc-a81e-48c9-90ab-52c6e71fa6fb tempest-GroupsV314Test-86166686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:01:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-37b219cc-a81e-48c9-90ab-52c6e71fa6fb tempest-GroupsV314Test-86166686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:01:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-37b219cc-a81e-48c9-90ab-52c6e71fa6fb tempest-GroupsV314Test-86166686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:51 devstack sudo[90628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:01:51 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:52 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-37b219cc-a81e-48c9-90ab-52c6e71fa6fb tempest-GroupsV314Test-86166686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.400s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:52 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-37b219cc-a81e-48c9-90ab-52c6e71fa6fb tempest-GroupsV314Test-86166686 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:01:52 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-37b219cc-a81e-48c9-90ab-52c6e71fa6fb tempest-GroupsV314Test-86166686 None] Delete group completed successfully.
Sep 07 18:01:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-25603d37-e716-495d-abfb-a649f412bcb2 tempest-TaggedAttachmentsTest-457261015 None] Acquiring lock "cinder-149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:01:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-25603d37-e716-495d-abfb-a649f412bcb2 tempest-TaggedAttachmentsTest-457261015 None] Lock "cinder-149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:01:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-25603d37-e716-495d-abfb-a649f412bcb2 tempest-TaggedAttachmentsTest-457261015 None] Acquiring lock "cinder-quobyte-149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:01:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-25603d37-e716-495d-abfb-a649f412bcb2 tempest-TaggedAttachmentsTest-457261015 None] Lock "cinder-quobyte-149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b" acquired by "delete_volume" :: waited 0.033s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:01:52 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbde8926-ab58-4e35-80c3-82d1c8bbd537]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:01:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-25603d37-e716-495d-abfb-a649f412bcb2 tempest-TaggedAttachmentsTest-457261015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:53 devstack sudo[90632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b
Sep 07 18:01:53 devstack sudo[90632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9c820a6b-61db-4290-aee1-6eb2b0eaa590 tempest-GroupsV314Test-86166686 None] Acquiring lock "cinder-quobyte-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:01:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9c820a6b-61db-4290-aee1-6eb2b0eaa590 tempest-GroupsV314Test-86166686 None] Lock "cinder-quobyte-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1" acquired by "delete_volume" :: waited 0.030s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:01:53 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cbb08c-f3ec-4088-8d1a-b21543a4ee8b]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:01:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c820a6b-61db-4290-aee1-6eb2b0eaa590 tempest-GroupsV314Test-86166686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:53 devstack sudo[90632]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-25603d37-e716-495d-abfb-a649f412bcb2 tempest-TaggedAttachmentsTest-457261015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b" returned: 0 in 0.757s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-25603d37-e716-495d-abfb-a649f412bcb2 tempest-TaggedAttachmentsTest-457261015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:53 devstack sudo[90638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b
Sep 07 18:01:53 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:53 devstack sudo[90635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1
Sep 07 18:01:53 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:54 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-25603d37-e716-495d-abfb-a649f412bcb2 tempest-TaggedAttachmentsTest-457261015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b" returned: 0 in 0.421s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-25603d37-e716-495d-abfb-a649f412bcb2 tempest-TaggedAttachmentsTest-457261015 None] Lock "cinder-quobyte-149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b" released by "delete_volume" :: held 1.264s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:01:54 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c820a6b-61db-4290-aee1-6eb2b0eaa590 tempest-GroupsV314Test-86166686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1" returned: 0 in 0.757s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c820a6b-61db-4290-aee1-6eb2b0eaa590 tempest-GroupsV314Test-86166686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:54 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-25603d37-e716-495d-abfb-a649f412bcb2 tempest-TaggedAttachmentsTest-457261015 None] Created reservations ['8a94e2c7-5771-48c8-b7e3-b6f2757f1682', 'aab2b2d7-1ba4-4ba0-a904-b6d4f474fe8d', '2bc9f9d3-4dd0-4d30-9aa4-c367021bc530', '69bf3a2e-3136-45cc-97fc-9277f53a2fe1'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:01:54 devstack sudo[90645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1
Sep 07 18:01:54 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-25603d37-e716-495d-abfb-a649f412bcb2 tempest-TaggedAttachmentsTest-457261015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:01:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-25603d37-e716-495d-abfb-a649f412bcb2 tempest-TaggedAttachmentsTest-457261015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:01:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-25603d37-e716-495d-abfb-a649f412bcb2 tempest-TaggedAttachmentsTest-457261015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:01:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-25603d37-e716-495d-abfb-a649f412bcb2 tempest-TaggedAttachmentsTest-457261015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:01:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-25603d37-e716-495d-abfb-a649f412bcb2 tempest-TaggedAttachmentsTest-457261015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:01:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-25603d37-e716-495d-abfb-a649f412bcb2 tempest-TaggedAttachmentsTest-457261015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:54 devstack sudo[90648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:01:54 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:54 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c820a6b-61db-4290-aee1-6eb2b0eaa590 tempest-GroupsV314Test-86166686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1" returned: 0 in 0.513s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9c820a6b-61db-4290-aee1-6eb2b0eaa590 tempest-GroupsV314Test-86166686 None] Lock "cinder-quobyte-9a52e6c8-b1dc-46cf-a2db-3f9bf8c926a1" released by "delete_volume" :: held 1.409s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:01:54 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-9c820a6b-61db-4290-aee1-6eb2b0eaa590 tempest-GroupsV314Test-86166686 None] Created reservations ['a83ea435-7f2a-43ea-9a68-642427ec3b13'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:01:55 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-25603d37-e716-495d-abfb-a649f412bcb2 tempest-TaggedAttachmentsTest-457261015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.602s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:55 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-25603d37-e716-495d-abfb-a649f412bcb2 tempest-TaggedAttachmentsTest-457261015 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:01:55 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-25603d37-e716-495d-abfb-a649f412bcb2 tempest-TaggedAttachmentsTest-457261015 None] Deleted volume successfully.
Sep 07 18:01:55 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-9c820a6b-61db-4290-aee1-6eb2b0eaa590 tempest-GroupsV314Test-86166686 None] Created reservations ['696ad2fc-d37d-4363-8f4e-d7d80d3b2376', '55d9ba84-0e60-4305-aa45-a3e554379ab2', '8e0eb467-5e35-4d63-b6ab-6da1287f1e66', '6f363816-c35e-4242-87be-e9830ee003fa'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:01:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-25603d37-e716-495d-abfb-a649f412bcb2 tempest-TaggedAttachmentsTest-457261015 None] Lock "cinder-149f4f9a-c4b2-4167-b47a-73ec1bf7dc9b-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:01:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9c820a6b-61db-4290-aee1-6eb2b0eaa590 tempest-GroupsV314Test-86166686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:01:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9c820a6b-61db-4290-aee1-6eb2b0eaa590 tempest-GroupsV314Test-86166686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:01:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9c820a6b-61db-4290-aee1-6eb2b0eaa590 tempest-GroupsV314Test-86166686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:01:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9c820a6b-61db-4290-aee1-6eb2b0eaa590 tempest-GroupsV314Test-86166686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:01:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9c820a6b-61db-4290-aee1-6eb2b0eaa590 tempest-GroupsV314Test-86166686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:01:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c820a6b-61db-4290-aee1-6eb2b0eaa590 tempest-GroupsV314Test-86166686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:01:55 devstack sudo[90653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:01:55 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:01:55 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root
Sep 07 18:01:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c820a6b-61db-4290-aee1-6eb2b0eaa590 tempest-GroupsV314Test-86166686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.491s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:01:55 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-9c820a6b-61db-4290-aee1-6eb2b0eaa590 tempest-GroupsV314Test-86166686 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:01:55 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9c820a6b-61db-4290-aee1-6eb2b0eaa590 tempest-GroupsV314Test-86166686 None] Delete group completed successfully.
Sep 07 18:02:00 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:02:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:02:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:02:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:02:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:02:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:02:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:00 devstack sudo[90699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:02:00 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:01 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.318s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:02:01 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:02:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread count: 8 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 07 18:02:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread info: [<_MainThread(MainThread, started 137533762306176)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137533650971072)>, <Thread(Thread-3 (stat_writer), started daemon 137533647226880)>, <Thread(Rabbit-heartbeat, started daemon 137533647437120)>, <Thread(Thread-5 (_runner), started daemon 137533648120896)>, <Thread(Thread-7 (_runner), started daemon 137533648182592)>, <Thread(fd_logger, started daemon 137533644336576)>, <Thread(privsep_reader, started daemon 137533643255424)>] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 07 18:02:05 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=29,cinder:SELECT=23,cinder:INSERT=9 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:02:05 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=36,cinder:SELECT=23,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:02:10 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:02:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Flow 'volume_create_manager' (420e770d-8453-402d-b882-2d092be1ffbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:02:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211f5b12-fda7-480b-94bc-464e11cdae0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211f5b12-fda7-480b-94bc-464e11cdae0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1628554891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b251c75-3b50-459e-b161-e61440d0ac60,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='617f347a5c014497940b1523f4302bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:02:11Z,use_quota=True,user_id='7cf51ca706d24865af248dbe76534c39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327b8894-2310-4527-9d27-46c83da3dca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327b8894-2310-4527-9d27-46c83da3dca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bbd3b89-68e7-4057-ab3c-fb5f8a20de4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bbd3b89-68e7-4057-ab3c-fb5f8a20de4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b251c75-3b50-459e-b161-e61440d0ac60', 'volume_name': 'volume-9b251c75-3b50-459e-b161-e61440d0ac60', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f050a8e-ce1b-4cfe-b098-d893b9751526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f050a8e-ce1b-4cfe-b098-d893b9751526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91bc0e7e-70e3-49b9-aff6-6e14081dcc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:10 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Volume 9b251c75-3b50-459e-b161-e61440d0ac60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b251c75-3b50-459e-b161-e61440d0ac60', 'volume_size': 1}
Sep 07 18:02:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:02:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:02:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1628554891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b251c75-3b50-459e-b161-e61440d0ac60,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='617f347a5c014497940b1523f4302bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:02:11Z,use_quota=True,user_id='7cf51ca706d24865af248dbe76534c39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:02:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Creating volume 9b251c75-3b50-459e-b161-e61440d0ac60 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:02:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:02:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:02:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:02:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:02:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:02:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:02:10 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:02:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b251c75-3b50-459e-b161-e61440d0ac60 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:10 devstack sudo[90743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b251c75-3b50-459e-b161-e61440d0ac60 1073741824
Sep 07 18:02:10 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:11 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b251c75-3b50-459e-b161-e61440d0ac60 1073741824" returned: 0 in 0.678s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b251c75-3b50-459e-b161-e61440d0ac60 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:11 devstack sudo[90751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b251c75-3b50-459e-b161-e61440d0ac60
Sep 07 18:02:11 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:11 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b251c75-3b50-459e-b161-e61440d0ac60" returned: 0 in 0.350s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:02:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:02:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91bc0e7e-70e3-49b9-aff6-6e14081dcc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b251c75-3b50-459e-b161-e61440d0ac60', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b6206e-d143-40db-89b6-84f6fe57526d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:11 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Volume volume-9b251c75-3b50-459e-b161-e61440d0ac60 (9b251c75-3b50-459e-b161-e61440d0ac60): created successfully
Sep 07 18:02:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b6206e-d143-40db-89b6-84f6fe57526d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Flow 'volume_create_manager' (420e770d-8453-402d-b882-2d092be1ffbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:02:12 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-66239b23-5390-4f92-a657-065a48f3a76d tempest-VolumesTestJSON-1887256782 None] Created volume successfully.
Sep 07 18:02:12 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:02:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Flow 'volume_create_manager' (8329a096-96b1-40d4-9277-ae479aec0f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:02:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3799f35c-b9a1-4c51-804b-563f212568de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3799f35c-b9a1-4c51-804b-563f212568de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-685048275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a820aa-9093-4dea-b59d-246fff96e396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a1933941a694612a2bdd456df49156e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:02:13Z,use_quota=True,user_id='5ca08ed5b6cb4f1ea9a150d45bce7974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d1b4b9-890d-4a07-80c8-e053dabf32e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49d1b4b9-890d-4a07-80c8-e053dabf32e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87e8910-e880-4414-8b43-8bb64b09cfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87e8910-e880-4414-8b43-8bb64b09cfc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9a820aa-9093-4dea-b59d-246fff96e396', 'volume_name': 'volume-b9a820aa-9093-4dea-b59d-246fff96e396', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b23c1825-e130-4219-a29c-dc6b97a8aa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b23c1825-e130-4219-a29c-dc6b97a8aa86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79878cc8-073f-429c-9b38-235368cad644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:12 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Volume b9a820aa-9093-4dea-b59d-246fff96e396: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9a820aa-9093-4dea-b59d-246fff96e396', 'volume_size': 1}
Sep 07 18:02:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:02:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:02:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-685048275',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a820aa-9093-4dea-b59d-246fff96e396,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a1933941a694612a2bdd456df49156e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:02:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:02:13Z,use_quota=True,user_id='5ca08ed5b6cb4f1ea9a150d45bce7974',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:02:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Creating volume b9a820aa-9093-4dea-b59d-246fff96e396 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:02:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:02:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:02:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:02:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:02:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:02:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:02:12 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:02:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:13 devstack sudo[90756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396 1073741824
Sep 07 18:02:13 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:13 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396 1073741824" returned: 0 in 0.601s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:13 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:02:13 devstack sudo[90762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396
Sep 07 18:02:13 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Flow 'volume_create_manager' (1586ac97-83ff-4104-8001-6470e5e83d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:02:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db58dbdc-691c-4c3c-bc39-de8203bd0099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db58dbdc-691c-4c3c-bc39-de8203bd0099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1916929547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='617f347a5c014497940b1523f4302bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:02:14Z,use_quota=True,user_id='7cf51ca706d24865af248dbe76534c39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05f9caca-4b73-44ee-8244-ffef20ebbf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05f9caca-4b73-44ee-8244-ffef20ebbf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4818107a-a3b4-4653-bba5-ef9a95a916f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4818107a-a3b4-4653-bba5-ef9a95a916f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07', 'volume_name': 'volume-1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3258b3c2-7694-4d5b-a55c-03d28566398c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3258b3c2-7694-4d5b-a55c-03d28566398c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b911a4cb-f1cb-49a4-a094-9e096f65608f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:13 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Volume 1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07', 'volume_size': 1}
Sep 07 18:02:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:02:14 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396" returned: 0 in 0.361s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:02:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:02:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.185s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:02:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:02:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1916929547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='617f347a5c014497940b1523f4302bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:02:14Z,use_quota=True,user_id='7cf51ca706d24865af248dbe76534c39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:02:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Creating volume 1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:02:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:02:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:02:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:02:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:02:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:02:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:02:14 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:02:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79878cc8-073f-429c-9b38-235368cad644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9a820aa-9093-4dea-b59d-246fff96e396', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec7ebccd-14b9-4ea4-913b-acaf1acae23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:14 devstack sudo[90765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07 1073741824
Sep 07 18:02:14 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:14 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Volume volume-b9a820aa-9093-4dea-b59d-246fff96e396 (b9a820aa-9093-4dea-b59d-246fff96e396): created successfully
Sep 07 18:02:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec7ebccd-14b9-4ea4-913b-acaf1acae23e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Flow 'volume_create_manager' (8329a096-96b1-40d4-9277-ae479aec0f4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:02:14 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0c270357-7193-4ada-b180-2ba4193ecc67 tempest-SnapshotsActionsTest-1831724479 None] Created volume successfully.
Sep 07 18:02:14 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07 1073741824" returned: 0 in 0.503s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:14 devstack sudo[90771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07
Sep 07 18:02:14 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:14 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07" returned: 0 in 0.257s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:02:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:02:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b911a4cb-f1cb-49a4-a094-9e096f65608f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4431018e-b950-4337-81fb-0ccc7f6a499f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:14 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Volume volume-1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07 (1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07): created successfully
Sep 07 18:02:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4431018e-b950-4337-81fb-0ccc7f6a499f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Flow 'volume_create_manager' (1586ac97-83ff-4104-8001-6470e5e83d7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:02:14 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e699ea71-a498-4925-9e63-bfbb98efda83 tempest-VolumesTestJSON-1887256782 None] Created volume successfully.
Sep 07 18:02:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ceb2bf5-6056-489d-8607-f58e41b376cc tempest-AttachVolumeShelveTestJSON-814281689 None] Acquiring lock "cinder-2a1524b6-27dd-40fa-8947-52fbbd86d0f6-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:02:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ceb2bf5-6056-489d-8607-f58e41b376cc tempest-AttachVolumeShelveTestJSON-814281689 None] Lock "cinder-2a1524b6-27dd-40fa-8947-52fbbd86d0f6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:02:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ceb2bf5-6056-489d-8607-f58e41b376cc tempest-AttachVolumeShelveTestJSON-814281689 None] Acquiring lock "cinder-quobyte-2a1524b6-27dd-40fa-8947-52fbbd86d0f6" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:02:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ceb2bf5-6056-489d-8607-f58e41b376cc tempest-AttachVolumeShelveTestJSON-814281689 None] Lock "cinder-quobyte-2a1524b6-27dd-40fa-8947-52fbbd86d0f6" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:02:15 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a29f61-e060-4bc0-a401-f16fb52e1c0c]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:02:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ceb2bf5-6056-489d-8607-f58e41b376cc tempest-AttachVolumeShelveTestJSON-814281689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a1524b6-27dd-40fa-8947-52fbbd86d0f6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:15 devstack sudo[90776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a1524b6-27dd-40fa-8947-52fbbd86d0f6
Sep 07 18:02:15 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2f287b84-8b11-4b1a-a4cf-8b8a78d6731d tempest-SnapshotsActionsTest-1831724479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:02:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2f287b84-8b11-4b1a-a4cf-8b8a78d6731d tempest-SnapshotsActionsTest-1831724479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:02:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-2f287b84-8b11-4b1a-a4cf-8b8a78d6731d tempest-SnapshotsActionsTest-1831724479 None] Creating offline snapshot fba76c94-1202-4e53-85bc-3667c8043ee6 of volume b9a820aa-9093-4dea-b59d-246fff96e396 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:02:15 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4bcb51-374b-4db3-8e5d-1b24308073b2]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:02:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2f287b84-8b11-4b1a-a4cf-8b8a78d6731d tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:15 devstack sudo[90778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396
Sep 07 18:02:15 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:15 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ceb2bf5-6056-489d-8607-f58e41b376cc tempest-AttachVolumeShelveTestJSON-814281689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a1524b6-27dd-40fa-8947-52fbbd86d0f6" returned: 0 in 0.435s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ceb2bf5-6056-489d-8607-f58e41b376cc tempest-AttachVolumeShelveTestJSON-814281689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a1524b6-27dd-40fa-8947-52fbbd86d0f6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:15 devstack sudo[90785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a1524b6-27dd-40fa-8947-52fbbd86d0f6
Sep 07 18:02:15 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:15 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2f287b84-8b11-4b1a-a4cf-8b8a78d6731d tempest-SnapshotsActionsTest-1831724479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396" returned: 0 in 0.429s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2f287b84-8b11-4b1a-a4cf-8b8a78d6731d tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:15 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:15 devstack sudo[90795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 1G
Sep 07 18:02:15 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ceb2bf5-6056-489d-8607-f58e41b376cc tempest-AttachVolumeShelveTestJSON-814281689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a1524b6-27dd-40fa-8947-52fbbd86d0f6" returned: 0 in 0.287s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ceb2bf5-6056-489d-8607-f58e41b376cc tempest-AttachVolumeShelveTestJSON-814281689 None] Lock "cinder-quobyte-2a1524b6-27dd-40fa-8947-52fbbd86d0f6" released by "delete_volume" :: held 0.787s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:02:15 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-5ceb2bf5-6056-489d-8607-f58e41b376cc tempest-AttachVolumeShelveTestJSON-814281689 None] Created reservations ['2331a2f9-58ca-4883-a8fe-39b1fdfd5ec8', 'ee704975-ad88-4426-9dbf-470aa567d942', '8598e671-31ad-49f3-8ace-03ad7270e508', 'aa4e9336-89a6-4157-9155-55ddde3ce9dc'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:02:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5ceb2bf5-6056-489d-8607-f58e41b376cc tempest-AttachVolumeShelveTestJSON-814281689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:02:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5ceb2bf5-6056-489d-8607-f58e41b376cc tempest-AttachVolumeShelveTestJSON-814281689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:02:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5ceb2bf5-6056-489d-8607-f58e41b376cc tempest-AttachVolumeShelveTestJSON-814281689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:02:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5ceb2bf5-6056-489d-8607-f58e41b376cc tempest-AttachVolumeShelveTestJSON-814281689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:02:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5ceb2bf5-6056-489d-8607-f58e41b376cc tempest-AttachVolumeShelveTestJSON-814281689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:02:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ceb2bf5-6056-489d-8607-f58e41b376cc tempest-AttachVolumeShelveTestJSON-814281689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:16 devstack sudo[90798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:02:16 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:16 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2f287b84-8b11-4b1a-a4cf-8b8a78d6731d tempest-SnapshotsActionsTest-1831724479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 1G" returned: 0 in 0.602s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2f287b84-8b11-4b1a-a4cf-8b8a78d6731d tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9a820aa-9093-4dea-b59d-246fff96e396 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:16 devstack sudo[90811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9a820aa-9093-4dea-b59d-246fff96e396 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6
Sep 07 18:02:16 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:16 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:02:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Flow 'volume_create_manager' (c4f73b65-aca1-493b-8e2c-202f4d6bf6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:02:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47ba78d-1dfd-4ea4-b7e9-b15a946af2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:16 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b47ba78d-1dfd-4ea4-b7e9-b15a946af2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-867700328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fda563b-27e3-418b-8b81-3757efc6382e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='617f347a5c014497940b1523f4302bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:02:16Z,use_quota=True,user_id='7cf51ca706d24865af248dbe76534c39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22ea27cd-e394-464b-9115-bae3736c99ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22ea27cd-e394-464b-9115-bae3736c99ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2872e57b-5fdc-4d32-895a-ac85725b2bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2872e57b-5fdc-4d32-895a-ac85725b2bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fda563b-27e3-418b-8b81-3757efc6382e', 'volume_name': 'volume-8fda563b-27e3-418b-8b81-3757efc6382e', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f286eda6-075c-4daa-8fae-a5d3e73886e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f286eda6-075c-4daa-8fae-a5d3e73886e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e0c906d-bf1b-454d-9821-174a6c3b93fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:16 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Volume 8fda563b-27e3-418b-8b81-3757efc6382e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fda563b-27e3-418b-8b81-3757efc6382e', 'volume_size': 1}
Sep 07 18:02:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:02:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5ceb2bf5-6056-489d-8607-f58e41b376cc tempest-AttachVolumeShelveTestJSON-814281689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.558s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:16 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-5ceb2bf5-6056-489d-8607-f58e41b376cc tempest-AttachVolumeShelveTestJSON-814281689 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:02:16 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5ceb2bf5-6056-489d-8607-f58e41b376cc tempest-AttachVolumeShelveTestJSON-814281689 None] Deleted volume successfully.
Sep 07 18:02:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-7f837648-1338-4b44-b352-dd1d4ee596cf req-383ebb94-1183-42a0-9598-ca761d9e4702 tempest-ServerActionsTestOtherA-1043843369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:02:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5ceb2bf5-6056-489d-8607-f58e41b376cc tempest-AttachVolumeShelveTestJSON-814281689 None] Lock "cinder-2a1524b6-27dd-40fa-8947-52fbbd86d0f6-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:02:16 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2f287b84-8b11-4b1a-a4cf-8b8a78d6731d tempest-SnapshotsActionsTest-1831724479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9a820aa-9093-4dea-b59d-246fff96e396 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6" returned: 0 in 0.346s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:16 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-2f287b84-8b11-4b1a-a4cf-8b8a78d6731d tempest-SnapshotsActionsTest-1831724479 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 is being set with open permissions: ugo+rw
Sep 07 18:02:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2f287b84-8b11-4b1a-a4cf-8b8a78d6731d tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:16 devstack sudo[90818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6
Sep 07 18:02:16 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:16 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2f287b84-8b11-4b1a-a4cf-8b8a78d6731d tempest-SnapshotsActionsTest-1831724479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6" returned: 0 in 0.237s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2f287b84-8b11-4b1a-a4cf-8b8a78d6731d tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:17 devstack sudo[90821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.info
Sep 07 18:02:17 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:17 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2f287b84-8b11-4b1a-a4cf-8b8a78d6731d tempest-SnapshotsActionsTest-1831724479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.info" returned: 0 in 0.306s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:17 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-2f287b84-8b11-4b1a-a4cf-8b8a78d6731d tempest-SnapshotsActionsTest-1831724479 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.info is being set with open permissions: ugo+rw
Sep 07 18:02:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2f287b84-8b11-4b1a-a4cf-8b8a78d6731d tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:17 devstack sudo[90824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.info
Sep 07 18:02:17 devstack sudo[90824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:17 devstack sudo[90824]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2f287b84-8b11-4b1a-a4cf-8b8a78d6731d tempest-SnapshotsActionsTest-1831724479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.info" returned: 0 in 0.258s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2f287b84-8b11-4b1a-a4cf-8b8a78d6731d tempest-SnapshotsActionsTest-1831724479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.265s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:02:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.022s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:02:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-867700328',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fda563b-27e3-418b-8b81-3757efc6382e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='617f347a5c014497940b1523f4302bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:02:16Z,use_quota=True,user_id='7cf51ca706d24865af248dbe76534c39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:02:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Creating volume 8fda563b-27e3-418b-8b81-3757efc6382e {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:02:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:02:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:02:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:02:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:02:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:02:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:02:17 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:02:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8fda563b-27e3-418b-8b81-3757efc6382e 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:17 devstack sudo[90827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8fda563b-27e3-418b-8b81-3757efc6382e 1073741824
Sep 07 18:02:17 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:17 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2f287b84-8b11-4b1a-a4cf-8b8a78d6731d tempest-SnapshotsActionsTest-1831724479 None] Create snapshot completed successfully
Sep 07 18:02:18 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8fda563b-27e3-418b-8b81-3757efc6382e 1073741824" returned: 0 in 0.476s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8fda563b-27e3-418b-8b81-3757efc6382e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:18 devstack sudo[90834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8fda563b-27e3-418b-8b81-3757efc6382e
Sep 07 18:02:18 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:18 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8fda563b-27e3-418b-8b81-3757efc6382e" returned: 0 in 0.244s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:02:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:02:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-7f837648-1338-4b44-b352-dd1d4ee596cf req-383ebb94-1183-42a0-9598-ca761d9e4702 tempest-ServerActionsTestOtherA-1043843369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.761s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:02:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e0c906d-bf1b-454d-9821-174a6c3b93fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fda563b-27e3-418b-8b81-3757efc6382e', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6feabba2-b4c6-40cb-8c3f-f5e84d18011b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-7f837648-1338-4b44-b352-dd1d4ee596cf req-383ebb94-1183-42a0-9598-ca761d9e4702 tempest-ServerActionsTestOtherA-1043843369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:02:18 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Volume volume-8fda563b-27e3-418b-8b81-3757efc6382e (8fda563b-27e3-418b-8b81-3757efc6382e): created successfully
Sep 07 18:02:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6feabba2-b4c6-40cb-8c3f-f5e84d18011b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Flow 'volume_create_manager' (c4f73b65-aca1-493b-8e2c-202f4d6bf6be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:02:18 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-61264fdb-3f28-476c-ac3d-8692c2a1ef18 tempest-VolumesTestJSON-1887256782 None] Created volume successfully.
Sep 07 18:02:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-7f837648-1338-4b44-b352-dd1d4ee596cf req-383ebb94-1183-42a0-9598-ca761d9e4702 tempest-ServerActionsTestOtherA-1043843369 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d', 'name': 'volume-aadee00d-d9cf-4485-af34-b998995255a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6de2143b-b208-44bd-b93b-8c9875be9be5', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 07 18:02:18 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-7f837648-1338-4b44-b352-dd1d4ee596cf req-383ebb94-1183-42a0-9598-ca761d9e4702 tempest-ServerActionsTestOtherA-1043843369 None] attachment_update completed successfully.
Sep 07 18:02:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4755e75c-db55-423b-a186-4d4186e39bad tempest-SnapshotsActionsTest-1831724479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:02:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4755e75c-db55-423b-a186-4d4186e39bad tempest-SnapshotsActionsTest-1831724479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:02:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4755e75c-db55-423b-a186-4d4186e39bad tempest-SnapshotsActionsTest-1831724479 None] Creating offline snapshot ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce of volume b9a820aa-9093-4dea-b59d-246fff96e396 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:02:19 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd53d1e-fb8e-46d3-9063-6291cab72755]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:02:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4755e75c-db55-423b-a186-4d4186e39bad tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:19 devstack sudo[91219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6
Sep 07 18:02:19 devstack sudo[91219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9682fbc4-005e-4c88-8f02-76b62258c861 tempest-VolumesTestJSON-1887256782 None] Acquiring lock "cinder-8fda563b-27e3-418b-8b81-3757efc6382e-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:02:19 devstack sudo[91219]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4755e75c-db55-423b-a186-4d4186e39bad tempest-SnapshotsActionsTest-1831724479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6" returned: 0 in 0.438s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4755e75c-db55-423b-a186-4d4186e39bad tempest-SnapshotsActionsTest-1831724479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9a820aa-9093-4dea-b59d-246fff96e396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:02:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4755e75c-db55-423b-a186-4d4186e39bad tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9682fbc4-005e-4c88-8f02-76b62258c861 tempest-VolumesTestJSON-1887256782 None] Lock "cinder-8fda563b-27e3-418b-8b81-3757efc6382e-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:02:19 devstack sudo[91224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce 1G
Sep 07 18:02:19 devstack sudo[91224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9682fbc4-005e-4c88-8f02-76b62258c861 tempest-VolumesTestJSON-1887256782 None] Acquiring lock "cinder-quobyte-8fda563b-27e3-418b-8b81-3757efc6382e" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:02:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9682fbc4-005e-4c88-8f02-76b62258c861 tempest-VolumesTestJSON-1887256782 None] Lock "cinder-quobyte-8fda563b-27e3-418b-8b81-3757efc6382e" acquired by "delete_volume" :: waited 0.034s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:02:20 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3aa236-7c2b-4aa5-b354-08c497d06290]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:02:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9682fbc4-005e-4c88-8f02-76b62258c861 tempest-VolumesTestJSON-1887256782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8fda563b-27e3-418b-8b81-3757efc6382e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:20 devstack sudo[91226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8fda563b-27e3-418b-8b81-3757efc6382e
Sep 07 18:02:20 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:20 devstack sudo[91224]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4755e75c-db55-423b-a186-4d4186e39bad tempest-SnapshotsActionsTest-1831724479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce 1G" returned: 0 in 0.552s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4755e75c-db55-423b-a186-4d4186e39bad tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:20 devstack sudo[91234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce
Sep 07 18:02:20 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:20 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9682fbc4-005e-4c88-8f02-76b62258c861 tempest-VolumesTestJSON-1887256782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8fda563b-27e3-418b-8b81-3757efc6382e" returned: 0 in 0.417s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9682fbc4-005e-4c88-8f02-76b62258c861 tempest-VolumesTestJSON-1887256782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8fda563b-27e3-418b-8b81-3757efc6382e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:20 devstack sudo[91238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8fda563b-27e3-418b-8b81-3757efc6382e
Sep 07 18:02:20 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:20 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9682fbc4-005e-4c88-8f02-76b62258c861 tempest-VolumesTestJSON-1887256782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8fda563b-27e3-418b-8b81-3757efc6382e" returned: 0 in 0.301s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9682fbc4-005e-4c88-8f02-76b62258c861 tempest-VolumesTestJSON-1887256782 None] Lock "cinder-quobyte-8fda563b-27e3-418b-8b81-3757efc6382e" released by "delete_volume" :: held 0.771s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:02:20 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4755e75c-db55-423b-a186-4d4186e39bad tempest-SnapshotsActionsTest-1831724479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce" returned: 0 in 0.398s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:20 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-4755e75c-db55-423b-a186-4d4186e39bad tempest-SnapshotsActionsTest-1831724479 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce is being set with open permissions: ugo+rw
Sep 07 18:02:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4755e75c-db55-423b-a186-4d4186e39bad tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:20 devstack sudo[91244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce
Sep 07 18:02:20 devstack sudo[91244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:20 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-9682fbc4-005e-4c88-8f02-76b62258c861 tempest-VolumesTestJSON-1887256782 None] Created reservations ['855e6586-5f10-4dd0-bd34-9028ef77463f', '0126e084-aec9-48f9-a262-db18bccaf58b', '64973064-6294-445f-a63c-e21112ff0a7b', '67a6c2fb-9634-4a79-abf2-a7d65ffcf1f1'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:02:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9682fbc4-005e-4c88-8f02-76b62258c861 tempest-VolumesTestJSON-1887256782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:02:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9682fbc4-005e-4c88-8f02-76b62258c861 tempest-VolumesTestJSON-1887256782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:02:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9682fbc4-005e-4c88-8f02-76b62258c861 tempest-VolumesTestJSON-1887256782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:02:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9682fbc4-005e-4c88-8f02-76b62258c861 tempest-VolumesTestJSON-1887256782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:02:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9682fbc4-005e-4c88-8f02-76b62258c861 tempest-VolumesTestJSON-1887256782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:02:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9682fbc4-005e-4c88-8f02-76b62258c861 tempest-VolumesTestJSON-1887256782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:21 devstack sudo[91247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:02:21 devstack sudo[91247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5bcfb9fd-220e-4847-96e3-49137efb6a1c tempest-VolumesTestJSON-1887256782 None] Acquiring lock "cinder-1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:02:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5bcfb9fd-220e-4847-96e3-49137efb6a1c tempest-VolumesTestJSON-1887256782 None] Lock "cinder-1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:02:21 devstack sudo[91244]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5bcfb9fd-220e-4847-96e3-49137efb6a1c tempest-VolumesTestJSON-1887256782 None] Acquiring lock "cinder-quobyte-1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:02:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4755e75c-db55-423b-a186-4d4186e39bad tempest-SnapshotsActionsTest-1831724479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce" returned: 0 in 0.429s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4755e75c-db55-423b-a186-4d4186e39bad tempest-SnapshotsActionsTest-1831724479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.977s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:02:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5bcfb9fd-220e-4847-96e3-49137efb6a1c tempest-VolumesTestJSON-1887256782 None] Lock "cinder-quobyte-1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07" acquired by "delete_volume" :: waited 0.066s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:02:21 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a341f8-7bb0-419e-96bd-5cf27ac651aa]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:02:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5bcfb9fd-220e-4847-96e3-49137efb6a1c tempest-VolumesTestJSON-1887256782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:21 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4755e75c-db55-423b-a186-4d4186e39bad tempest-SnapshotsActionsTest-1831724479 None] Create snapshot completed successfully
Sep 07 18:02:21 devstack sudo[91247]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9682fbc4-005e-4c88-8f02-76b62258c861 tempest-VolumesTestJSON-1887256782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.397s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:21 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-9682fbc4-005e-4c88-8f02-76b62258c861 tempest-VolumesTestJSON-1887256782 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:02:21 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9682fbc4-005e-4c88-8f02-76b62258c861 tempest-VolumesTestJSON-1887256782 None] Deleted volume successfully.
Sep 07 18:02:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9682fbc4-005e-4c88-8f02-76b62258c861 tempest-VolumesTestJSON-1887256782 None] Lock "cinder-8fda563b-27e3-418b-8b81-3757efc6382e-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:02:21 devstack sudo[91251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07
Sep 07 18:02:21 devstack sudo[91251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:21 devstack sudo[91251]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5bcfb9fd-220e-4847-96e3-49137efb6a1c tempest-VolumesTestJSON-1887256782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07" returned: 0 in 0.424s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5bcfb9fd-220e-4847-96e3-49137efb6a1c tempest-VolumesTestJSON-1887256782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:21 devstack sudo[91257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07
Sep 07 18:02:21 devstack sudo[91257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:22 devstack sudo[91257]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5bcfb9fd-220e-4847-96e3-49137efb6a1c tempest-VolumesTestJSON-1887256782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07" returned: 0 in 0.381s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5bcfb9fd-220e-4847-96e3-49137efb6a1c tempest-VolumesTestJSON-1887256782 None] Lock "cinder-quobyte-1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07" released by "delete_volume" :: held 0.882s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:02:22 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-5bcfb9fd-220e-4847-96e3-49137efb6a1c tempest-VolumesTestJSON-1887256782 None] Created reservations ['d890392c-ed51-4c74-9b73-dda96ad6b0c9', '7cb53c71-6d8f-444e-8d1a-0e438fe3e202', 'f2b154da-649e-43a6-a310-720fb652dde5', '63db7ebe-e310-44f9-a9df-82a7b2eb5fbe'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:02:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5bcfb9fd-220e-4847-96e3-49137efb6a1c tempest-VolumesTestJSON-1887256782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:02:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5bcfb9fd-220e-4847-96e3-49137efb6a1c tempest-VolumesTestJSON-1887256782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:02:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5bcfb9fd-220e-4847-96e3-49137efb6a1c tempest-VolumesTestJSON-1887256782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:02:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5bcfb9fd-220e-4847-96e3-49137efb6a1c tempest-VolumesTestJSON-1887256782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:02:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5bcfb9fd-220e-4847-96e3-49137efb6a1c tempest-VolumesTestJSON-1887256782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:02:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5bcfb9fd-220e-4847-96e3-49137efb6a1c tempest-VolumesTestJSON-1887256782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:22 devstack sudo[91270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:02:22 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6e3d3506-07d9-4d5d-bf47-40e96a3b9a2d tempest-SnapshotsActionsTest-1337185504 None] Acquiring lock "cinder-ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:02:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6e3d3506-07d9-4d5d-bf47-40e96a3b9a2d tempest-SnapshotsActionsTest-1337185504 None] Lock "cinder-ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:02:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6e3d3506-07d9-4d5d-bf47-40e96a3b9a2d tempest-SnapshotsActionsTest-1337185504 None] Acquiring lock "cinder-quobyte-b9a820aa-9093-4dea-b59d-246fff96e396" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:02:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6e3d3506-07d9-4d5d-bf47-40e96a3b9a2d tempest-SnapshotsActionsTest-1337185504 None] Lock "cinder-quobyte-b9a820aa-9093-4dea-b59d-246fff96e396" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:02:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6e3d3506-07d9-4d5d-bf47-40e96a3b9a2d tempest-SnapshotsActionsTest-1337185504 None] Acquiring lock "cinder-quobyte-ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:02:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6e3d3506-07d9-4d5d-bf47-40e96a3b9a2d tempest-SnapshotsActionsTest-1337185504 None] Lock "cinder-quobyte-ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:02:22 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-6e3d3506-07d9-4d5d-bf47-40e96a3b9a2d tempest-SnapshotsActionsTest-1337185504 None] Deleting offline snapshot ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce of volume b9a820aa-9093-4dea-b59d-246fff96e396 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:02:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-6e3d3506-07d9-4d5d-bf47-40e96a3b9a2d tempest-SnapshotsActionsTest-1337185504 None] snapshot_file for this snap is: volume-b9a820aa-9093-4dea-b59d-246fff96e396.ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:02:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5bcfb9fd-220e-4847-96e3-49137efb6a1c tempest-VolumesTestJSON-1887256782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.333s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:22 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-5bcfb9fd-220e-4847-96e3-49137efb6a1c tempest-VolumesTestJSON-1887256782 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:02:22 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5bcfb9fd-220e-4847-96e3-49137efb6a1c tempest-VolumesTestJSON-1887256782 None] Deleted volume successfully.
Sep 07 18:02:22 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd05876c-9434-464a-b2ae-dd20b1e9a48a]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:02:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e3d3506-07d9-4d5d-bf47-40e96a3b9a2d tempest-SnapshotsActionsTest-1337185504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5bcfb9fd-220e-4847-96e3-49137efb6a1c tempest-VolumesTestJSON-1887256782 None] Lock "cinder-1c5d2f34-040c-4a9e-b9b0-a8756cfc6c07-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:02:22 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-9e9154e7-3a62-4eec-9638-9d5e08951459 req-913bf2ef-1a8b-4869-94f3-fae6563867db tempest-ServerActionsTestOtherA-1043843369 None] Terminate volume connection completed successfully.
Sep 07 18:02:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-9e9154e7-3a62-4eec-9638-9d5e08951459 req-913bf2ef-1a8b-4869-94f3-fae6563867db tempest-ServerActionsTestOtherA-1043843369 None] Deleting attachment 6de2143b-b208-44bd-b93b-8c9875be9be5. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 07 18:02:22 devstack sudo[91278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce
Sep 07 18:02:22 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:23 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e3d3506-07d9-4d5d-bf47-40e96a3b9a2d tempest-SnapshotsActionsTest-1337185504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce" returned: 0 in 0.538s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-6e3d3506-07d9-4d5d-bf47-40e96a3b9a2d tempest-SnapshotsActionsTest-1337185504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9a820aa-9093-4dea-b59d-246fff96e396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:02:23 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71a997f-65e6-49fd-b82a-24a8242e91ea]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:02:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e3d3506-07d9-4d5d-bf47-40e96a3b9a2d tempest-SnapshotsActionsTest-1337185504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d45fc072-1065-4f0c-9d1c-b7e199b6bdd7 tempest-VolumesTestJSON-1887256782 None] Acquiring lock "cinder-9b251c75-3b50-459e-b161-e61440d0ac60-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:02:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d45fc072-1065-4f0c-9d1c-b7e199b6bdd7 tempest-VolumesTestJSON-1887256782 None] Lock "cinder-9b251c75-3b50-459e-b161-e61440d0ac60-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:02:23 devstack sudo[91322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6
Sep 07 18:02:23 devstack sudo[91322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d45fc072-1065-4f0c-9d1c-b7e199b6bdd7 tempest-VolumesTestJSON-1887256782 None] Acquiring lock "cinder-quobyte-9b251c75-3b50-459e-b161-e61440d0ac60" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:02:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d45fc072-1065-4f0c-9d1c-b7e199b6bdd7 tempest-VolumesTestJSON-1887256782 None] Lock "cinder-quobyte-9b251c75-3b50-459e-b161-e61440d0ac60" acquired by "delete_volume" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:02:23 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c605899f-fd68-40b4-9a13-4e228019b1f8]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:02:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d45fc072-1065-4f0c-9d1c-b7e199b6bdd7 tempest-VolumesTestJSON-1887256782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b251c75-3b50-459e-b161-e61440d0ac60 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:23 devstack sudo[91338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b251c75-3b50-459e-b161-e61440d0ac60
Sep 07 18:02:23 devstack sudo[91338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-9e9154e7-3a62-4eec-9638-9d5e08951459 req-df8f557d-bf32-49ee-9de8-15356df99df1 tempest-ServerActionsTestOtherA-1043843369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:02:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-9e9154e7-3a62-4eec-9638-9d5e08951459 req-df8f557d-bf32-49ee-9de8-15356df99df1 tempest-ServerActionsTestOtherA-1043843369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:02:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-9e9154e7-3a62-4eec-9638-9d5e08951459 req-df8f557d-bf32-49ee-9de8-15356df99df1 tempest-ServerActionsTestOtherA-1043843369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:02:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-9e9154e7-3a62-4eec-9638-9d5e08951459 req-df8f557d-bf32-49ee-9de8-15356df99df1 tempest-ServerActionsTestOtherA-1043843369 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d', 'name': 'volume-aadee00d-d9cf-4485-af34-b998995255a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4040746-299a-457a-b0f3-a0f5a69ca5ab', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 07 18:02:23 devstack sudo[91322]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e3d3506-07d9-4d5d-bf47-40e96a3b9a2d tempest-SnapshotsActionsTest-1337185504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6" returned: 0 in 0.664s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-6e3d3506-07d9-4d5d-bf47-40e96a3b9a2d tempest-SnapshotsActionsTest-1337185504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9a820aa-9093-4dea-b59d-246fff96e396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:02:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e3d3506-07d9-4d5d-bf47-40e96a3b9a2d tempest-SnapshotsActionsTest-1337185504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:24 devstack sudo[91343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce
Sep 07 18:02:24 devstack sudo[91343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:24 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-9e9154e7-3a62-4eec-9638-9d5e08951459 req-df8f557d-bf32-49ee-9de8-15356df99df1 tempest-ServerActionsTestOtherA-1043843369 None] attachment_update completed successfully.
Sep 07 18:02:24 devstack sudo[91338]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d45fc072-1065-4f0c-9d1c-b7e199b6bdd7 tempest-VolumesTestJSON-1887256782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b251c75-3b50-459e-b161-e61440d0ac60" returned: 0 in 0.533s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d45fc072-1065-4f0c-9d1c-b7e199b6bdd7 tempest-VolumesTestJSON-1887256782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b251c75-3b50-459e-b161-e61440d0ac60 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:24 devstack sudo[91349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b251c75-3b50-459e-b161-e61440d0ac60
Sep 07 18:02:24 devstack sudo[91349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:24 devstack sudo[91343]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e3d3506-07d9-4d5d-bf47-40e96a3b9a2d tempest-SnapshotsActionsTest-1337185504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce" returned: 0 in 0.552s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e3d3506-07d9-4d5d-bf47-40e96a3b9a2d tempest-SnapshotsActionsTest-1337185504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:24 devstack sudo[91357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce
Sep 07 18:02:24 devstack sudo[91357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:24 devstack sudo[91349]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d45fc072-1065-4f0c-9d1c-b7e199b6bdd7 tempest-VolumesTestJSON-1887256782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b251c75-3b50-459e-b161-e61440d0ac60" returned: 0 in 0.375s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d45fc072-1065-4f0c-9d1c-b7e199b6bdd7 tempest-VolumesTestJSON-1887256782 None] Lock "cinder-quobyte-9b251c75-3b50-459e-b161-e61440d0ac60" released by "delete_volume" :: held 1.006s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:02:24 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-d45fc072-1065-4f0c-9d1c-b7e199b6bdd7 tempest-VolumesTestJSON-1887256782 None] Created reservations ['ed4c309d-c89e-4b5c-9f1e-65afe5196df4', 'dfee85f7-a3e1-4b73-9719-9b96ac13e413', '8c7cb356-2c28-4a36-9ee7-6840f93be315', '9a1c063d-e91d-4940-b8b7-1554d8628013'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:02:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d45fc072-1065-4f0c-9d1c-b7e199b6bdd7 tempest-VolumesTestJSON-1887256782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:02:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d45fc072-1065-4f0c-9d1c-b7e199b6bdd7 tempest-VolumesTestJSON-1887256782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:02:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d45fc072-1065-4f0c-9d1c-b7e199b6bdd7 tempest-VolumesTestJSON-1887256782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:02:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d45fc072-1065-4f0c-9d1c-b7e199b6bdd7 tempest-VolumesTestJSON-1887256782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:02:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d45fc072-1065-4f0c-9d1c-b7e199b6bdd7 tempest-VolumesTestJSON-1887256782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:02:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d45fc072-1065-4f0c-9d1c-b7e199b6bdd7 tempest-VolumesTestJSON-1887256782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:24 devstack sudo[91362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:02:24 devstack sudo[91362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:24 devstack sudo[91357]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e3d3506-07d9-4d5d-bf47-40e96a3b9a2d tempest-SnapshotsActionsTest-1337185504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce" returned: 0 in 0.404s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6e3d3506-07d9-4d5d-bf47-40e96a3b9a2d tempest-SnapshotsActionsTest-1337185504 None] Lock "cinder-quobyte-ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce" released by "_delete_snapshot" :: held 2.303s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:02:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6e3d3506-07d9-4d5d-bf47-40e96a3b9a2d tempest-SnapshotsActionsTest-1337185504 None] Lock "cinder-quobyte-b9a820aa-9093-4dea-b59d-246fff96e396" released by "delete_snapshot" :: held 2.347s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:02:25 devstack cinder-volume[87269]: WARNING cinder.quota [None req-6e3d3506-07d9-4d5d-bf47-40e96a3b9a2d tempest-SnapshotsActionsTest-1337185504 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:02:25 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-6e3d3506-07d9-4d5d-bf47-40e96a3b9a2d tempest-SnapshotsActionsTest-1337185504 None] Created reservations ['30107cb2-fb4b-4a4b-b2a8-24f182eb3105', 'cb97e5d4-a5e2-4df2-ad17-1c2e804a534c', 'c4064920-bbc4-444a-b86a-c69fb415ff27', '134d0949-feba-47e0-8c04-ded3e6fe526e'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:02:25 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-6e3d3506-07d9-4d5d-bf47-40e96a3b9a2d tempest-SnapshotsActionsTest-1337185504 None] Delete snapshot completed successfully.
Sep 07 18:02:25 devstack sudo[91362]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6e3d3506-07d9-4d5d-bf47-40e96a3b9a2d tempest-SnapshotsActionsTest-1337185504 None] Lock "cinder-ad2b5cc4-8c01-400d-930e-7d4b75c9b6ce-delete_snapshot" released by "delete_snapshot" :: held 2.609s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:02:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d45fc072-1065-4f0c-9d1c-b7e199b6bdd7 tempest-VolumesTestJSON-1887256782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.378s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:25 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-d45fc072-1065-4f0c-9d1c-b7e199b6bdd7 tempest-VolumesTestJSON-1887256782 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:02:25 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d45fc072-1065-4f0c-9d1c-b7e199b6bdd7 tempest-VolumesTestJSON-1887256782 None] Deleted volume successfully.
Sep 07 18:02:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d45fc072-1065-4f0c-9d1c-b7e199b6bdd7 tempest-VolumesTestJSON-1887256782 None] Lock "cinder-9b251c75-3b50-459e-b161-e61440d0ac60-delete_volume" released by "delete_volume" :: held 1.749s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:02:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cb9446b9-740f-401e-9dec-0ff323eb99fd tempest-SnapshotsActionsTest-1831724479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:02:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cb9446b9-740f-401e-9dec-0ff323eb99fd tempest-SnapshotsActionsTest-1831724479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:02:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-cb9446b9-740f-401e-9dec-0ff323eb99fd tempest-SnapshotsActionsTest-1831724479 None] Creating offline snapshot 235e3df8-e572-4795-8f63-1a06a70e0ddb of volume b9a820aa-9093-4dea-b59d-246fff96e396 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:02:26 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44a431a-a5f0-4171-8271-9398d3c0e239]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:02:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cb9446b9-740f-401e-9dec-0ff323eb99fd tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:26 devstack sudo[91796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6
Sep 07 18:02:26 devstack sudo[91796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:27 devstack sudo[91796]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cb9446b9-740f-401e-9dec-0ff323eb99fd tempest-SnapshotsActionsTest-1831724479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6" returned: 0 in 0.477s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-cb9446b9-740f-401e-9dec-0ff323eb99fd tempest-SnapshotsActionsTest-1831724479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9a820aa-9093-4dea-b59d-246fff96e396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:02:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cb9446b9-740f-401e-9dec-0ff323eb99fd tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.235e3df8-e572-4795-8f63-1a06a70e0ddb 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:27 devstack sudo[91803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.235e3df8-e572-4795-8f63-1a06a70e0ddb 1G
Sep 07 18:02:27 devstack sudo[91803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:27 devstack sudo[91803]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cb9446b9-740f-401e-9dec-0ff323eb99fd tempest-SnapshotsActionsTest-1831724479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.235e3df8-e572-4795-8f63-1a06a70e0ddb 1G" returned: 0 in 0.757s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cb9446b9-740f-401e-9dec-0ff323eb99fd tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.235e3df8-e572-4795-8f63-1a06a70e0ddb {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:27 devstack sudo[91812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.235e3df8-e572-4795-8f63-1a06a70e0ddb
Sep 07 18:02:27 devstack sudo[91812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:28 devstack sudo[91812]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cb9446b9-740f-401e-9dec-0ff323eb99fd tempest-SnapshotsActionsTest-1831724479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.235e3df8-e572-4795-8f63-1a06a70e0ddb" returned: 0 in 0.651s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:28 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-cb9446b9-740f-401e-9dec-0ff323eb99fd tempest-SnapshotsActionsTest-1831724479 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.235e3df8-e572-4795-8f63-1a06a70e0ddb is being set with open permissions: ugo+rw
Sep 07 18:02:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cb9446b9-740f-401e-9dec-0ff323eb99fd tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.235e3df8-e572-4795-8f63-1a06a70e0ddb {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:28 devstack sudo[91817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.235e3df8-e572-4795-8f63-1a06a70e0ddb
Sep 07 18:02:28 devstack sudo[91817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:28 devstack sudo[91817]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cb9446b9-740f-401e-9dec-0ff323eb99fd tempest-SnapshotsActionsTest-1831724479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.235e3df8-e572-4795-8f63-1a06a70e0ddb" returned: 0 in 0.331s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cb9446b9-740f-401e-9dec-0ff323eb99fd tempest-SnapshotsActionsTest-1831724479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.367s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:02:28 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-cb9446b9-740f-401e-9dec-0ff323eb99fd tempest-SnapshotsActionsTest-1831724479 None] Create snapshot completed successfully
Sep 07 18:02:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-87e2b270-ccdc-4ba7-81e8-ef06a9ff4140 tempest-SnapshotsActionsTest-1337185504 None] Acquiring lock "cinder-235e3df8-e572-4795-8f63-1a06a70e0ddb-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:02:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-87e2b270-ccdc-4ba7-81e8-ef06a9ff4140 tempest-SnapshotsActionsTest-1337185504 None] Lock "cinder-235e3df8-e572-4795-8f63-1a06a70e0ddb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:02:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-87e2b270-ccdc-4ba7-81e8-ef06a9ff4140 tempest-SnapshotsActionsTest-1337185504 None] Acquiring lock "cinder-quobyte-b9a820aa-9093-4dea-b59d-246fff96e396" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:02:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-87e2b270-ccdc-4ba7-81e8-ef06a9ff4140 tempest-SnapshotsActionsTest-1337185504 None] Lock "cinder-quobyte-b9a820aa-9093-4dea-b59d-246fff96e396" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:02:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-87e2b270-ccdc-4ba7-81e8-ef06a9ff4140 tempest-SnapshotsActionsTest-1337185504 None] Acquiring lock "cinder-quobyte-235e3df8-e572-4795-8f63-1a06a70e0ddb" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:02:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-87e2b270-ccdc-4ba7-81e8-ef06a9ff4140 tempest-SnapshotsActionsTest-1337185504 None] Lock "cinder-quobyte-235e3df8-e572-4795-8f63-1a06a70e0ddb" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:02:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-87e2b270-ccdc-4ba7-81e8-ef06a9ff4140 tempest-SnapshotsActionsTest-1337185504 None] Deleting offline snapshot 235e3df8-e572-4795-8f63-1a06a70e0ddb of volume b9a820aa-9093-4dea-b59d-246fff96e396 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:02:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-87e2b270-ccdc-4ba7-81e8-ef06a9ff4140 tempest-SnapshotsActionsTest-1337185504 None] snapshot_file for this snap is: volume-b9a820aa-9093-4dea-b59d-246fff96e396.235e3df8-e572-4795-8f63-1a06a70e0ddb {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:02:30 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[472ee620-fd0a-4b4a-b3f4-b38b5d44a9b3]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:02:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-87e2b270-ccdc-4ba7-81e8-ef06a9ff4140 tempest-SnapshotsActionsTest-1337185504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.235e3df8-e572-4795-8f63-1a06a70e0ddb {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:30 devstack sudo[91820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.235e3df8-e572-4795-8f63-1a06a70e0ddb
Sep 07 18:02:30 devstack sudo[91820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:30 devstack sudo[91820]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-87e2b270-ccdc-4ba7-81e8-ef06a9ff4140 tempest-SnapshotsActionsTest-1337185504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.235e3df8-e572-4795-8f63-1a06a70e0ddb" returned: 0 in 0.464s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-87e2b270-ccdc-4ba7-81e8-ef06a9ff4140 tempest-SnapshotsActionsTest-1337185504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9a820aa-9093-4dea-b59d-246fff96e396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:02:30 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9f7f3a-7dfc-432f-8f1d-3976df82c335]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:02:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-87e2b270-ccdc-4ba7-81e8-ef06a9ff4140 tempest-SnapshotsActionsTest-1337185504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:30 devstack sudo[91839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6
Sep 07 18:02:30 devstack sudo[91839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:31 devstack sudo[91839]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-87e2b270-ccdc-4ba7-81e8-ef06a9ff4140 tempest-SnapshotsActionsTest-1337185504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6" returned: 0 in 0.392s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-87e2b270-ccdc-4ba7-81e8-ef06a9ff4140 tempest-SnapshotsActionsTest-1337185504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9a820aa-9093-4dea-b59d-246fff96e396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:02:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-87e2b270-ccdc-4ba7-81e8-ef06a9ff4140 tempest-SnapshotsActionsTest-1337185504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.235e3df8-e572-4795-8f63-1a06a70e0ddb {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:31 devstack sudo[91844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.235e3df8-e572-4795-8f63-1a06a70e0ddb
Sep 07 18:02:31 devstack sudo[91844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:31 devstack sudo[91844]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-87e2b270-ccdc-4ba7-81e8-ef06a9ff4140 tempest-SnapshotsActionsTest-1337185504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.235e3df8-e572-4795-8f63-1a06a70e0ddb" returned: 0 in 0.446s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-87e2b270-ccdc-4ba7-81e8-ef06a9ff4140 tempest-SnapshotsActionsTest-1337185504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.235e3df8-e572-4795-8f63-1a06a70e0ddb {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:31 devstack sudo[91850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.235e3df8-e572-4795-8f63-1a06a70e0ddb
Sep 07 18:02:31 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:31 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-87e2b270-ccdc-4ba7-81e8-ef06a9ff4140 tempest-SnapshotsActionsTest-1337185504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.235e3df8-e572-4795-8f63-1a06a70e0ddb" returned: 0 in 0.267s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-87e2b270-ccdc-4ba7-81e8-ef06a9ff4140 tempest-SnapshotsActionsTest-1337185504 None] Lock "cinder-quobyte-235e3df8-e572-4795-8f63-1a06a70e0ddb" released by "_delete_snapshot" :: held 1.694s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:02:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-87e2b270-ccdc-4ba7-81e8-ef06a9ff4140 tempest-SnapshotsActionsTest-1337185504 None] Lock "cinder-quobyte-b9a820aa-9093-4dea-b59d-246fff96e396" released by "delete_snapshot" :: held 1.736s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:02:31 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-87e2b270-ccdc-4ba7-81e8-ef06a9ff4140 tempest-SnapshotsActionsTest-1337185504 None] Created reservations ['6fee76a0-1900-4f17-9e58-211732ba88c7', '0e169354-46dc-4c38-8b03-7bc156ed9eb0', 'dfbf73b4-a97d-4eb9-95ff-84bbc8a01311', 'e062e5f9-a2e4-4176-bf3a-64323d69f878'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:02:32 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-87e2b270-ccdc-4ba7-81e8-ef06a9ff4140 tempest-SnapshotsActionsTest-1337185504 None] Delete snapshot completed successfully.
Sep 07 18:02:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-87e2b270-ccdc-4ba7-81e8-ef06a9ff4140 tempest-SnapshotsActionsTest-1337185504 None] Lock "cinder-235e3df8-e572-4795-8f63-1a06a70e0ddb-delete_snapshot" released by "delete_snapshot" :: held 2.147s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:02:32 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-6a27079f-f671-47ea-be1d-6b6d891d64c7 tempest-GroupsV320Test-445605898 None] Group tempest-GroupsV320Test-Group-1909876553: creating
Sep 07 18:02:32 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-6a27079f-f671-47ea-be1d-6b6d891d64c7 tempest-GroupsV320Test-445605898 None] Group tempest-GroupsV320Test-Group-1909876553: created successfully
Sep 07 18:02:32 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-6a27079f-f671-47ea-be1d-6b6d891d64c7 tempest-GroupsV320Test-445605898 None] Create group completed successfully.
Sep 07 18:02:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c0733652-17f6-48c0-9622-b7f170701e87 tempest-SnapshotsActionsTest-1831724479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:02:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c0733652-17f6-48c0-9622-b7f170701e87 tempest-SnapshotsActionsTest-1831724479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:02:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-c0733652-17f6-48c0-9622-b7f170701e87 tempest-SnapshotsActionsTest-1831724479 None] Creating offline snapshot 7fdfae5a-ae0d-4572-9013-cbb013d72fcf of volume b9a820aa-9093-4dea-b59d-246fff96e396 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:02:32 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed0a9e2-d1df-47e5-93e9-8d8d09785359]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:02:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c0733652-17f6-48c0-9622-b7f170701e87 tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:32 devstack sudo[91853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6
Sep 07 18:02:32 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:33 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c0733652-17f6-48c0-9622-b7f170701e87 tempest-SnapshotsActionsTest-1831724479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6" returned: 0 in 0.505s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-c0733652-17f6-48c0-9622-b7f170701e87 tempest-SnapshotsActionsTest-1831724479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9a820aa-9093-4dea-b59d-246fff96e396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:02:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c0733652-17f6-48c0-9622-b7f170701e87 tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.7fdfae5a-ae0d-4572-9013-cbb013d72fcf 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:33 devstack sudo[91858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.7fdfae5a-ae0d-4572-9013-cbb013d72fcf 1G
Sep 07 18:02:33 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:34 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c0733652-17f6-48c0-9622-b7f170701e87 tempest-SnapshotsActionsTest-1831724479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.7fdfae5a-ae0d-4572-9013-cbb013d72fcf 1G" returned: 0 in 0.794s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c0733652-17f6-48c0-9622-b7f170701e87 tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.7fdfae5a-ae0d-4572-9013-cbb013d72fcf {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:34 devstack sudo[91863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.7fdfae5a-ae0d-4572-9013-cbb013d72fcf
Sep 07 18:02:34 devstack sudo[91863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:34 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-0673c56f-d905-4c3c-a9db-b8321c669398 tempest-GroupsV320Test-445605898 None] Created reservations ['43c67848-bf6c-4ab1-b969-13a73d16e92a'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:02:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0673c56f-d905-4c3c-a9db-b8321c669398 tempest-GroupsV320Test-445605898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:02:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0673c56f-d905-4c3c-a9db-b8321c669398 tempest-GroupsV320Test-445605898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:02:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0673c56f-d905-4c3c-a9db-b8321c669398 tempest-GroupsV320Test-445605898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:02:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0673c56f-d905-4c3c-a9db-b8321c669398 tempest-GroupsV320Test-445605898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:02:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0673c56f-d905-4c3c-a9db-b8321c669398 tempest-GroupsV320Test-445605898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:02:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0673c56f-d905-4c3c-a9db-b8321c669398 tempest-GroupsV320Test-445605898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:34 devstack sudo[91867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:02:34 devstack sudo[91867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:34 devstack sudo[91863]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c0733652-17f6-48c0-9622-b7f170701e87 tempest-SnapshotsActionsTest-1831724479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.7fdfae5a-ae0d-4572-9013-cbb013d72fcf" returned: 0 in 0.530s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:34 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-c0733652-17f6-48c0-9622-b7f170701e87 tempest-SnapshotsActionsTest-1831724479 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.7fdfae5a-ae0d-4572-9013-cbb013d72fcf is being set with open permissions: ugo+rw
Sep 07 18:02:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c0733652-17f6-48c0-9622-b7f170701e87 tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.7fdfae5a-ae0d-4572-9013-cbb013d72fcf {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:34 devstack sudo[91870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.7fdfae5a-ae0d-4572-9013-cbb013d72fcf
Sep 07 18:02:34 devstack sudo[91870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:34 devstack sudo[91867]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0673c56f-d905-4c3c-a9db-b8321c669398 tempest-GroupsV320Test-445605898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.437s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:34 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-0673c56f-d905-4c3c-a9db-b8321c669398 tempest-GroupsV320Test-445605898 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:02:34 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0673c56f-d905-4c3c-a9db-b8321c669398 tempest-GroupsV320Test-445605898 None] Delete group completed successfully.
Sep 07 18:02:35 devstack sudo[91870]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c0733652-17f6-48c0-9622-b7f170701e87 tempest-SnapshotsActionsTest-1831724479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.7fdfae5a-ae0d-4572-9013-cbb013d72fcf" returned: 0 in 0.478s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c0733652-17f6-48c0-9622-b7f170701e87 tempest-SnapshotsActionsTest-1831724479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.428s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:02:35 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-c0733652-17f6-48c0-9622-b7f170701e87 tempest-SnapshotsActionsTest-1831724479 None] Create snapshot completed successfully
Sep 07 18:02:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8fbb508d-90dc-4985-8447-689d5f8cbfe2 tempest-SnapshotsActionsTest-1337185504 None] Acquiring lock "cinder-7fdfae5a-ae0d-4572-9013-cbb013d72fcf-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:02:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8fbb508d-90dc-4985-8447-689d5f8cbfe2 tempest-SnapshotsActionsTest-1337185504 None] Lock "cinder-7fdfae5a-ae0d-4572-9013-cbb013d72fcf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:02:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8fbb508d-90dc-4985-8447-689d5f8cbfe2 tempest-SnapshotsActionsTest-1337185504 None] Acquiring lock "cinder-quobyte-b9a820aa-9093-4dea-b59d-246fff96e396" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:02:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8fbb508d-90dc-4985-8447-689d5f8cbfe2 tempest-SnapshotsActionsTest-1337185504 None] Lock "cinder-quobyte-b9a820aa-9093-4dea-b59d-246fff96e396" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:02:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8fbb508d-90dc-4985-8447-689d5f8cbfe2 tempest-SnapshotsActionsTest-1337185504 None] Acquiring lock "cinder-quobyte-7fdfae5a-ae0d-4572-9013-cbb013d72fcf" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:02:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8fbb508d-90dc-4985-8447-689d5f8cbfe2 tempest-SnapshotsActionsTest-1337185504 None] Lock "cinder-quobyte-7fdfae5a-ae0d-4572-9013-cbb013d72fcf" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:02:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-8fbb508d-90dc-4985-8447-689d5f8cbfe2 tempest-SnapshotsActionsTest-1337185504 None] Deleting offline snapshot 7fdfae5a-ae0d-4572-9013-cbb013d72fcf of volume b9a820aa-9093-4dea-b59d-246fff96e396 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:02:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-8fbb508d-90dc-4985-8447-689d5f8cbfe2 tempest-SnapshotsActionsTest-1337185504 None] snapshot_file for this snap is: volume-b9a820aa-9093-4dea-b59d-246fff96e396.7fdfae5a-ae0d-4572-9013-cbb013d72fcf {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:02:36 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[97490a9e-1be5-4d0b-a430-5ad50fdae991]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:02:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8fbb508d-90dc-4985-8447-689d5f8cbfe2 tempest-SnapshotsActionsTest-1337185504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.7fdfae5a-ae0d-4572-9013-cbb013d72fcf {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:36 devstack sudo[91876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.7fdfae5a-ae0d-4572-9013-cbb013d72fcf
Sep 07 18:02:36 devstack sudo[91876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:36 devstack sudo[91876]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8fbb508d-90dc-4985-8447-689d5f8cbfe2 tempest-SnapshotsActionsTest-1337185504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.7fdfae5a-ae0d-4572-9013-cbb013d72fcf" returned: 0 in 0.542s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-8fbb508d-90dc-4985-8447-689d5f8cbfe2 tempest-SnapshotsActionsTest-1337185504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9a820aa-9093-4dea-b59d-246fff96e396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:02:36 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03b7181-4968-49f1-8b99-e8083a07fd2a]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:02:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8fbb508d-90dc-4985-8447-689d5f8cbfe2 tempest-SnapshotsActionsTest-1337185504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:37 devstack sudo[91881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6
Sep 07 18:02:37 devstack sudo[91881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:37 devstack sudo[91881]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8fbb508d-90dc-4985-8447-689d5f8cbfe2 tempest-SnapshotsActionsTest-1337185504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6" returned: 0 in 0.653s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-8fbb508d-90dc-4985-8447-689d5f8cbfe2 tempest-SnapshotsActionsTest-1337185504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9a820aa-9093-4dea-b59d-246fff96e396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:02:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8fbb508d-90dc-4985-8447-689d5f8cbfe2 tempest-SnapshotsActionsTest-1337185504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.7fdfae5a-ae0d-4572-9013-cbb013d72fcf {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:37 devstack sudo[91888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.7fdfae5a-ae0d-4572-9013-cbb013d72fcf
Sep 07 18:02:37 devstack sudo[91888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:38 devstack sudo[91888]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8fbb508d-90dc-4985-8447-689d5f8cbfe2 tempest-SnapshotsActionsTest-1337185504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.7fdfae5a-ae0d-4572-9013-cbb013d72fcf" returned: 0 in 0.791s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8fbb508d-90dc-4985-8447-689d5f8cbfe2 tempest-SnapshotsActionsTest-1337185504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.7fdfae5a-ae0d-4572-9013-cbb013d72fcf {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:38 devstack sudo[91911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.7fdfae5a-ae0d-4572-9013-cbb013d72fcf
Sep 07 18:02:38 devstack sudo[91911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:38 devstack sudo[91911]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8fbb508d-90dc-4985-8447-689d5f8cbfe2 tempest-SnapshotsActionsTest-1337185504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.7fdfae5a-ae0d-4572-9013-cbb013d72fcf" returned: 0 in 0.366s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8fbb508d-90dc-4985-8447-689d5f8cbfe2 tempest-SnapshotsActionsTest-1337185504 None] Lock "cinder-quobyte-7fdfae5a-ae0d-4572-9013-cbb013d72fcf" released by "_delete_snapshot" :: held 2.528s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:02:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8fbb508d-90dc-4985-8447-689d5f8cbfe2 tempest-SnapshotsActionsTest-1337185504 None] Lock "cinder-quobyte-b9a820aa-9093-4dea-b59d-246fff96e396" released by "delete_snapshot" :: held 2.575s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:02:39 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-8fbb508d-90dc-4985-8447-689d5f8cbfe2 tempest-SnapshotsActionsTest-1337185504 None] Created reservations ['2e89913c-ffa5-4b5c-bb88-019038e5f8df', '294ebae2-702c-4e91-b6ff-b23b6f6ab859', 'ddbef0a7-f7c3-4e83-98fb-d55a3c69da32', 'f9c4397a-182b-4cbb-9a57-446dcd4be3d4'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:02:39 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-8fbb508d-90dc-4985-8447-689d5f8cbfe2 tempest-SnapshotsActionsTest-1337185504 None] Delete snapshot completed successfully.
Sep 07 18:02:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8fbb508d-90dc-4985-8447-689d5f8cbfe2 tempest-SnapshotsActionsTest-1337185504 None] Lock "cinder-7fdfae5a-ae0d-4572-9013-cbb013d72fcf-delete_snapshot" released by "delete_snapshot" :: held 2.880s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:02:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9d8bb442-b75a-4bce-ae88-0b4da0ef80f0 tempest-SnapshotsActionsTest-1831724479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:02:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9d8bb442-b75a-4bce-ae88-0b4da0ef80f0 tempest-SnapshotsActionsTest-1831724479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:02:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9d8bb442-b75a-4bce-ae88-0b4da0ef80f0 tempest-SnapshotsActionsTest-1831724479 None] Creating offline snapshot b222889b-05a0-4868-a077-8551d2a9d74d of volume b9a820aa-9093-4dea-b59d-246fff96e396 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:02:40 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[200f5f7a-9667-4068-a84f-517be4d0ff80]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:02:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d8bb442-b75a-4bce-ae88-0b4da0ef80f0 tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:40 devstack sudo[91914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6
Sep 07 18:02:40 devstack sudo[91914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:40 devstack sudo[91914]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d8bb442-b75a-4bce-ae88-0b4da0ef80f0 tempest-SnapshotsActionsTest-1831724479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6" returned: 0 in 0.591s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9d8bb442-b75a-4bce-ae88-0b4da0ef80f0 tempest-SnapshotsActionsTest-1831724479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9a820aa-9093-4dea-b59d-246fff96e396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:02:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d8bb442-b75a-4bce-ae88-0b4da0ef80f0 tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.b222889b-05a0-4868-a077-8551d2a9d74d 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:40 devstack sudo[91942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.b222889b-05a0-4868-a077-8551d2a9d74d 1G
Sep 07 18:02:40 devstack sudo[91942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:41 devstack sudo[91942]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d8bb442-b75a-4bce-ae88-0b4da0ef80f0 tempest-SnapshotsActionsTest-1831724479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.b222889b-05a0-4868-a077-8551d2a9d74d 1G" returned: 0 in 0.630s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d8bb442-b75a-4bce-ae88-0b4da0ef80f0 tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.b222889b-05a0-4868-a077-8551d2a9d74d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:41 devstack sudo[91964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.b222889b-05a0-4868-a077-8551d2a9d74d
Sep 07 18:02:41 devstack sudo[91964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:41 devstack sudo[91964]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d8bb442-b75a-4bce-ae88-0b4da0ef80f0 tempest-SnapshotsActionsTest-1831724479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.b222889b-05a0-4868-a077-8551d2a9d74d" returned: 0 in 0.322s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:41 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-9d8bb442-b75a-4bce-ae88-0b4da0ef80f0 tempest-SnapshotsActionsTest-1831724479 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.b222889b-05a0-4868-a077-8551d2a9d74d is being set with open permissions: ugo+rw
Sep 07 18:02:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d8bb442-b75a-4bce-ae88-0b4da0ef80f0 tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.b222889b-05a0-4868-a077-8551d2a9d74d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:41 devstack sudo[91969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.b222889b-05a0-4868-a077-8551d2a9d74d
Sep 07 18:02:41 devstack sudo[91969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:41 devstack sudo[91969]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d8bb442-b75a-4bce-ae88-0b4da0ef80f0 tempest-SnapshotsActionsTest-1831724479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.b222889b-05a0-4868-a077-8551d2a9d74d" returned: 0 in 0.280s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9d8bb442-b75a-4bce-ae88-0b4da0ef80f0 tempest-SnapshotsActionsTest-1831724479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.960s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:02:41 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9d8bb442-b75a-4bce-ae88-0b4da0ef80f0 tempest-SnapshotsActionsTest-1831724479 None] Create snapshot completed successfully
Sep 07 18:02:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-11102c42-7df2-4d60-86b6-1b093f1e1b64 tempest-SnapshotsActionsTest-1337185504 None] Acquiring lock "cinder-b222889b-05a0-4868-a077-8551d2a9d74d-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:02:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-11102c42-7df2-4d60-86b6-1b093f1e1b64 tempest-SnapshotsActionsTest-1337185504 None] Lock "cinder-b222889b-05a0-4868-a077-8551d2a9d74d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:02:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-11102c42-7df2-4d60-86b6-1b093f1e1b64 tempest-SnapshotsActionsTest-1337185504 None] Acquiring lock "cinder-quobyte-b9a820aa-9093-4dea-b59d-246fff96e396" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:02:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-11102c42-7df2-4d60-86b6-1b093f1e1b64 tempest-SnapshotsActionsTest-1337185504 None] Lock "cinder-quobyte-b9a820aa-9093-4dea-b59d-246fff96e396" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:02:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-11102c42-7df2-4d60-86b6-1b093f1e1b64 tempest-SnapshotsActionsTest-1337185504 None] Acquiring lock "cinder-quobyte-b222889b-05a0-4868-a077-8551d2a9d74d" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:02:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-11102c42-7df2-4d60-86b6-1b093f1e1b64 tempest-SnapshotsActionsTest-1337185504 None] Lock "cinder-quobyte-b222889b-05a0-4868-a077-8551d2a9d74d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:02:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-11102c42-7df2-4d60-86b6-1b093f1e1b64 tempest-SnapshotsActionsTest-1337185504 None] Deleting offline snapshot b222889b-05a0-4868-a077-8551d2a9d74d of volume b9a820aa-9093-4dea-b59d-246fff96e396 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:02:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-11102c42-7df2-4d60-86b6-1b093f1e1b64 tempest-SnapshotsActionsTest-1337185504 None] snapshot_file for this snap is: volume-b9a820aa-9093-4dea-b59d-246fff96e396.b222889b-05a0-4868-a077-8551d2a9d74d {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:02:42 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70cc2e1-721e-435c-a66a-0c86a9b2b7a3]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:02:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11102c42-7df2-4d60-86b6-1b093f1e1b64 tempest-SnapshotsActionsTest-1337185504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.b222889b-05a0-4868-a077-8551d2a9d74d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:42 devstack sudo[91972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.b222889b-05a0-4868-a077-8551d2a9d74d
Sep 07 18:02:42 devstack sudo[91972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:42 devstack sudo[91972]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11102c42-7df2-4d60-86b6-1b093f1e1b64 tempest-SnapshotsActionsTest-1337185504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.b222889b-05a0-4868-a077-8551d2a9d74d" returned: 0 in 0.422s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-11102c42-7df2-4d60-86b6-1b093f1e1b64 tempest-SnapshotsActionsTest-1337185504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9a820aa-9093-4dea-b59d-246fff96e396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:02:42 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2826162d-fd0d-4171-a042-ba61d763edc4]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:02:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11102c42-7df2-4d60-86b6-1b093f1e1b64 tempest-SnapshotsActionsTest-1337185504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:42 devstack sudo[91981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6
Sep 07 18:02:42 devstack sudo[91981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:43 devstack sudo[91981]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11102c42-7df2-4d60-86b6-1b093f1e1b64 tempest-SnapshotsActionsTest-1337185504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6" returned: 0 in 0.423s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-11102c42-7df2-4d60-86b6-1b093f1e1b64 tempest-SnapshotsActionsTest-1337185504 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9a820aa-9093-4dea-b59d-246fff96e396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:02:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11102c42-7df2-4d60-86b6-1b093f1e1b64 tempest-SnapshotsActionsTest-1337185504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.b222889b-05a0-4868-a077-8551d2a9d74d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:43 devstack sudo[91988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.b222889b-05a0-4868-a077-8551d2a9d74d
Sep 07 18:02:43 devstack sudo[91988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:43 devstack sudo[91988]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11102c42-7df2-4d60-86b6-1b093f1e1b64 tempest-SnapshotsActionsTest-1337185504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.b222889b-05a0-4868-a077-8551d2a9d74d" returned: 0 in 0.485s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11102c42-7df2-4d60-86b6-1b093f1e1b64 tempest-SnapshotsActionsTest-1337185504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.b222889b-05a0-4868-a077-8551d2a9d74d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:43 devstack sudo[91995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.b222889b-05a0-4868-a077-8551d2a9d74d
Sep 07 18:02:43 devstack sudo[91995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:43 devstack sudo[91995]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-11102c42-7df2-4d60-86b6-1b093f1e1b64 tempest-SnapshotsActionsTest-1337185504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.b222889b-05a0-4868-a077-8551d2a9d74d" returned: 0 in 0.304s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-11102c42-7df2-4d60-86b6-1b093f1e1b64 tempest-SnapshotsActionsTest-1337185504 None] Lock "cinder-quobyte-b222889b-05a0-4868-a077-8551d2a9d74d" released by "_delete_snapshot" :: held 1.760s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:02:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-11102c42-7df2-4d60-86b6-1b093f1e1b64 tempest-SnapshotsActionsTest-1337185504 None] Lock "cinder-quobyte-b9a820aa-9093-4dea-b59d-246fff96e396" released by "delete_snapshot" :: held 1.795s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:02:44 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-11102c42-7df2-4d60-86b6-1b093f1e1b64 tempest-SnapshotsActionsTest-1337185504 None] Created reservations ['192b8cbf-17bb-4b94-ac85-b5a22518021f', 'e74a6507-e471-447d-9fa3-869c3cccc015', 'fa07f5c8-6506-4de4-a039-af51a8c83d3e', 'c047ecaa-4a59-4d1d-9bf9-5413f41a7094'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:02:44 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-11102c42-7df2-4d60-86b6-1b093f1e1b64 tempest-SnapshotsActionsTest-1337185504 None] Delete snapshot completed successfully.
Sep 07 18:02:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-11102c42-7df2-4d60-86b6-1b093f1e1b64 tempest-SnapshotsActionsTest-1337185504 None] Lock "cinder-b222889b-05a0-4868-a077-8551d2a9d74d-delete_snapshot" released by "delete_snapshot" :: held 1.980s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:02:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2add3257-8b89-4595-b7b2-3c00b2eb35e6 tempest-SnapshotsActionsTest-1831724479 None] Acquiring lock "cinder-fba76c94-1202-4e53-85bc-3667c8043ee6-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:02:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2add3257-8b89-4595-b7b2-3c00b2eb35e6 tempest-SnapshotsActionsTest-1831724479 None] Lock "cinder-fba76c94-1202-4e53-85bc-3667c8043ee6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:02:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2add3257-8b89-4595-b7b2-3c00b2eb35e6 tempest-SnapshotsActionsTest-1831724479 None] Acquiring lock "cinder-quobyte-b9a820aa-9093-4dea-b59d-246fff96e396" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:02:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2add3257-8b89-4595-b7b2-3c00b2eb35e6 tempest-SnapshotsActionsTest-1831724479 None] Lock "cinder-quobyte-b9a820aa-9093-4dea-b59d-246fff96e396" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:02:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2add3257-8b89-4595-b7b2-3c00b2eb35e6 tempest-SnapshotsActionsTest-1831724479 None] Acquiring lock "cinder-quobyte-fba76c94-1202-4e53-85bc-3667c8043ee6" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:02:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2add3257-8b89-4595-b7b2-3c00b2eb35e6 tempest-SnapshotsActionsTest-1831724479 None] Lock "cinder-quobyte-fba76c94-1202-4e53-85bc-3667c8043ee6" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:02:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-2add3257-8b89-4595-b7b2-3c00b2eb35e6 tempest-SnapshotsActionsTest-1831724479 None] Deleting offline snapshot fba76c94-1202-4e53-85bc-3667c8043ee6 of volume b9a820aa-9093-4dea-b59d-246fff96e396 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:02:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-2add3257-8b89-4595-b7b2-3c00b2eb35e6 tempest-SnapshotsActionsTest-1831724479 None] snapshot_file for this snap is: volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:02:45 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8143a10b-75a9-429e-878c-cb18ce61fd52]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:02:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2add3257-8b89-4595-b7b2-3c00b2eb35e6 tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:45 devstack sudo[92015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6
Sep 07 18:02:45 devstack sudo[92015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:45 devstack sudo[92015]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2add3257-8b89-4595-b7b2-3c00b2eb35e6 tempest-SnapshotsActionsTest-1831724479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6" returned: 0 in 0.455s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-2add3257-8b89-4595-b7b2-3c00b2eb35e6 tempest-SnapshotsActionsTest-1831724479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9a820aa-9093-4dea-b59d-246fff96e396(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:02:45 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[339dd96a-dbcd-4ba5-acc5-f23a080faa2c]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:02:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2add3257-8b89-4595-b7b2-3c00b2eb35e6 tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:45 devstack sudo[92045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396
Sep 07 18:02:45 devstack sudo[92045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:46 devstack sudo[92045]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2add3257-8b89-4595-b7b2-3c00b2eb35e6 tempest-SnapshotsActionsTest-1831724479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396" returned: 0 in 0.390s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2add3257-8b89-4595-b7b2-3c00b2eb35e6 tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:46 devstack sudo[92050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6
Sep 07 18:02:46 devstack sudo[92050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:46 devstack sudo[92050]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2add3257-8b89-4595-b7b2-3c00b2eb35e6 tempest-SnapshotsActionsTest-1831724479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6" returned: 0 in 0.514s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2add3257-8b89-4595-b7b2-3c00b2eb35e6 tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:46 devstack sudo[92058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6
Sep 07 18:02:46 devstack sudo[92058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:46 devstack sudo[92058]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2add3257-8b89-4595-b7b2-3c00b2eb35e6 tempest-SnapshotsActionsTest-1831724479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396.fba76c94-1202-4e53-85bc-3667c8043ee6" returned: 0 in 0.451s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2add3257-8b89-4595-b7b2-3c00b2eb35e6 tempest-SnapshotsActionsTest-1831724479 None] Lock "cinder-quobyte-fba76c94-1202-4e53-85bc-3667c8043ee6" released by "_delete_snapshot" :: held 2.009s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:02:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2add3257-8b89-4595-b7b2-3c00b2eb35e6 tempest-SnapshotsActionsTest-1831724479 None] Lock "cinder-quobyte-b9a820aa-9093-4dea-b59d-246fff96e396" released by "delete_snapshot" :: held 2.043s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:02:47 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-2add3257-8b89-4595-b7b2-3c00b2eb35e6 tempest-SnapshotsActionsTest-1831724479 None] Created reservations ['32e602b7-8bb2-4786-a2fd-c45c811cd638', '3d380f1e-7815-4ba0-a08c-40dc2f0ade90', '4f07820b-b198-4969-9ceb-e4c8d7b5b517', '37d4fc2e-1d43-44d2-b691-114525da3ca6'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:02:47 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2add3257-8b89-4595-b7b2-3c00b2eb35e6 tempest-SnapshotsActionsTest-1831724479 None] Delete snapshot completed successfully.
Sep 07 18:02:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2add3257-8b89-4595-b7b2-3c00b2eb35e6 tempest-SnapshotsActionsTest-1831724479 None] Lock "cinder-fba76c94-1202-4e53-85bc-3667c8043ee6-delete_snapshot" released by "delete_snapshot" :: held 2.383s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:02:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f57bcc96-f8ea-4f1b-9809-53f6aec10bc4 tempest-SnapshotsActionsTest-1831724479 None] Acquiring lock "cinder-b9a820aa-9093-4dea-b59d-246fff96e396-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:02:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f57bcc96-f8ea-4f1b-9809-53f6aec10bc4 tempest-SnapshotsActionsTest-1831724479 None] Lock "cinder-b9a820aa-9093-4dea-b59d-246fff96e396-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:02:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f57bcc96-f8ea-4f1b-9809-53f6aec10bc4 tempest-SnapshotsActionsTest-1831724479 None] Acquiring lock "cinder-quobyte-b9a820aa-9093-4dea-b59d-246fff96e396" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:02:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f57bcc96-f8ea-4f1b-9809-53f6aec10bc4 tempest-SnapshotsActionsTest-1831724479 None] Lock "cinder-quobyte-b9a820aa-9093-4dea-b59d-246fff96e396" acquired by "delete_volume" :: waited 0.027s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:02:48 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0256132-cdd9-441f-8e7b-15b472469a3c]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:02:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f57bcc96-f8ea-4f1b-9809-53f6aec10bc4 tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:48 devstack sudo[92127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396
Sep 07 18:02:48 devstack sudo[92127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:49 devstack sudo[92127]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f57bcc96-f8ea-4f1b-9809-53f6aec10bc4 tempest-SnapshotsActionsTest-1831724479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396" returned: 0 in 0.629s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f57bcc96-f8ea-4f1b-9809-53f6aec10bc4 tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:49 devstack sudo[92134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396
Sep 07 18:02:49 devstack sudo[92134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:49 devstack sudo[92134]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f57bcc96-f8ea-4f1b-9809-53f6aec10bc4 tempest-SnapshotsActionsTest-1831724479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b9a820aa-9093-4dea-b59d-246fff96e396" returned: 0 in 0.336s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f57bcc96-f8ea-4f1b-9809-53f6aec10bc4 tempest-SnapshotsActionsTest-1831724479 None] Lock "cinder-quobyte-b9a820aa-9093-4dea-b59d-246fff96e396" released by "delete_volume" :: held 1.099s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:02:49 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-f57bcc96-f8ea-4f1b-9809-53f6aec10bc4 tempest-SnapshotsActionsTest-1831724479 None] Created reservations ['725f9a88-07a1-4570-a163-02a2a9364cba', '2b168008-cc98-469e-9bdc-d2f04d54460c', 'e8476683-916d-4608-872c-0221cb69a799', 'f1107ccd-8876-43f4-9466-9dab09986c32'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:02:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f57bcc96-f8ea-4f1b-9809-53f6aec10bc4 tempest-SnapshotsActionsTest-1831724479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:02:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f57bcc96-f8ea-4f1b-9809-53f6aec10bc4 tempest-SnapshotsActionsTest-1831724479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:02:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f57bcc96-f8ea-4f1b-9809-53f6aec10bc4 tempest-SnapshotsActionsTest-1831724479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:02:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f57bcc96-f8ea-4f1b-9809-53f6aec10bc4 tempest-SnapshotsActionsTest-1831724479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:02:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f57bcc96-f8ea-4f1b-9809-53f6aec10bc4 tempest-SnapshotsActionsTest-1831724479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:02:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f57bcc96-f8ea-4f1b-9809-53f6aec10bc4 tempest-SnapshotsActionsTest-1831724479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:49 devstack sudo[92140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:02:49 devstack sudo[92140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:50 devstack sudo[92140]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f57bcc96-f8ea-4f1b-9809-53f6aec10bc4 tempest-SnapshotsActionsTest-1831724479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.514s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:50 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f57bcc96-f8ea-4f1b-9809-53f6aec10bc4 tempest-SnapshotsActionsTest-1831724479 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:02:50 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f57bcc96-f8ea-4f1b-9809-53f6aec10bc4 tempest-SnapshotsActionsTest-1831724479 None] Deleted volume successfully.
Sep 07 18:02:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f57bcc96-f8ea-4f1b-9809-53f6aec10bc4 tempest-SnapshotsActionsTest-1831724479 None] Lock "cinder-b9a820aa-9093-4dea-b59d-246fff96e396-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:02:51 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-4f534cfe-3c47-4adc-a9ca-feebb9b2dfcb req-99ae160c-13be-4e96-b991-3bdbdb53b64b tempest-ServerActionsTestOtherA-1043843369 None] Terminate volume connection completed successfully.
Sep 07 18:02:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-4f534cfe-3c47-4adc-a9ca-feebb9b2dfcb req-99ae160c-13be-4e96-b991-3bdbdb53b64b tempest-ServerActionsTestOtherA-1043843369 None] Deleting attachment f4040746-299a-457a-b0f3-a0f5a69ca5ab. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 07 18:02:54 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:02:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Flow 'volume_create_manager' (6949a04b-ebe0-4f5a-8f17-3363cbec9a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:02:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f36866-88ec-463c-b3f2-d4d5773cbf80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f36866-88ec-463c-b3f2-d4d5773cbf80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1201762659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f9c943-1011-44df-83bb-a008ff275977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6e97bbd38c14d6bb6ed1254f59d2869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:02:54Z,use_quota=True,user_id='96fd2e343cfd43baa0685bc3c2b47456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (331e027b-fd94-4a8a-8d30-598da2b7c3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (331e027b-fd94-4a8a-8d30-598da2b7c3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (712d309a-de12-4bbc-bbca-3863dbd26073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (712d309a-de12-4bbc-bbca-3863dbd26073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31f9c943-1011-44df-83bb-a008ff275977', 'volume_name': 'volume-31f9c943-1011-44df-83bb-a008ff275977', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d482cf-308f-46c7-bb53-9db68ee85042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d482cf-308f-46c7-bb53-9db68ee85042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f4f53e-5fb6-4345-a186-21c561b9eba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:54 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Volume 31f9c943-1011-44df-83bb-a008ff275977: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31f9c943-1011-44df-83bb-a008ff275977', 'volume_size': 1}
Sep 07 18:02:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:02:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:02:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1201762659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f9c943-1011-44df-83bb-a008ff275977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6e97bbd38c14d6bb6ed1254f59d2869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:02:54Z,use_quota=True,user_id='96fd2e343cfd43baa0685bc3c2b47456',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:02:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Creating volume 31f9c943-1011-44df-83bb-a008ff275977 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:02:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:02:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:02:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:02:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:02:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:02:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:02:54 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:02:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-31f9c943-1011-44df-83bb-a008ff275977 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:54 devstack sudo[92176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-31f9c943-1011-44df-83bb-a008ff275977 1073741824
Sep 07 18:02:54 devstack sudo[92176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:55 devstack sudo[92176]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-31f9c943-1011-44df-83bb-a008ff275977 1073741824" returned: 0 in 0.567s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-31f9c943-1011-44df-83bb-a008ff275977 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:55 devstack sudo[92183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-31f9c943-1011-44df-83bb-a008ff275977
Sep 07 18:02:55 devstack sudo[92183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:55 devstack sudo[92183]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-31f9c943-1011-44df-83bb-a008ff275977" returned: 0 in 0.328s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:02:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:02:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f4f53e-5fb6-4345-a186-21c561b9eba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31f9c943-1011-44df-83bb-a008ff275977', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc70955-7ebb-49b9-94ff-344f908ac7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:02:55 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Volume volume-31f9c943-1011-44df-83bb-a008ff275977 (31f9c943-1011-44df-83bb-a008ff275977): created successfully
Sep 07 18:02:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc70955-7ebb-49b9-94ff-344f908ac7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:02:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Flow 'volume_create_manager' (6949a04b-ebe0-4f5a-8f17-3363cbec9a55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:02:55 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-bbadc0f6-7e2b-4ff2-adbc-434746e132c2 tempest-VolumeQuotasNegativeTestJSON-598224028 None] Created volume successfully.
Sep 07 18:02:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c213ac8a-84fc-4e9e-8e45-358f51830d5e tempest-VolumeQuotasNegativeTestJSON-598224028 None] Acquiring lock "cinder-31f9c943-1011-44df-83bb-a008ff275977-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:02:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c213ac8a-84fc-4e9e-8e45-358f51830d5e tempest-VolumeQuotasNegativeTestJSON-598224028 None] Lock "cinder-31f9c943-1011-44df-83bb-a008ff275977-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:02:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c213ac8a-84fc-4e9e-8e45-358f51830d5e tempest-VolumeQuotasNegativeTestJSON-598224028 None] Acquiring lock "cinder-quobyte-31f9c943-1011-44df-83bb-a008ff275977" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:02:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c213ac8a-84fc-4e9e-8e45-358f51830d5e tempest-VolumeQuotasNegativeTestJSON-598224028 None] Lock "cinder-quobyte-31f9c943-1011-44df-83bb-a008ff275977" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:02:58 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[62303f51-9677-43ca-99c3-36ffd958de0f]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:02:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c213ac8a-84fc-4e9e-8e45-358f51830d5e tempest-VolumeQuotasNegativeTestJSON-598224028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-31f9c943-1011-44df-83bb-a008ff275977 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:58 devstack sudo[92191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-31f9c943-1011-44df-83bb-a008ff275977
Sep 07 18:02:58 devstack sudo[92191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:58 devstack sudo[92191]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c213ac8a-84fc-4e9e-8e45-358f51830d5e tempest-VolumeQuotasNegativeTestJSON-598224028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-31f9c943-1011-44df-83bb-a008ff275977" returned: 0 in 0.524s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c213ac8a-84fc-4e9e-8e45-358f51830d5e tempest-VolumeQuotasNegativeTestJSON-598224028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-31f9c943-1011-44df-83bb-a008ff275977 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:58 devstack sudo[92230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-31f9c943-1011-44df-83bb-a008ff275977
Sep 07 18:02:58 devstack sudo[92230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:59 devstack sudo[92230]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c213ac8a-84fc-4e9e-8e45-358f51830d5e tempest-VolumeQuotasNegativeTestJSON-598224028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-31f9c943-1011-44df-83bb-a008ff275977" returned: 0 in 0.453s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c213ac8a-84fc-4e9e-8e45-358f51830d5e tempest-VolumeQuotasNegativeTestJSON-598224028 None] Lock "cinder-quobyte-31f9c943-1011-44df-83bb-a008ff275977" released by "delete_volume" :: held 1.059s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:02:59 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-c213ac8a-84fc-4e9e-8e45-358f51830d5e tempest-VolumeQuotasNegativeTestJSON-598224028 None] Created reservations ['c28791a7-4c10-4669-9ac5-8a0ac26ebde4', 'b7cb1baa-70e1-4283-b9aa-ea7a2b3ad49a', 'f3870417-7f21-41e1-bc63-6aa323c801b9', '293297c3-a3ea-495a-befa-44c2d0309540'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:02:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c213ac8a-84fc-4e9e-8e45-358f51830d5e tempest-VolumeQuotasNegativeTestJSON-598224028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:02:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c213ac8a-84fc-4e9e-8e45-358f51830d5e tempest-VolumeQuotasNegativeTestJSON-598224028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:02:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c213ac8a-84fc-4e9e-8e45-358f51830d5e tempest-VolumeQuotasNegativeTestJSON-598224028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:02:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c213ac8a-84fc-4e9e-8e45-358f51830d5e tempest-VolumeQuotasNegativeTestJSON-598224028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:02:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c213ac8a-84fc-4e9e-8e45-358f51830d5e tempest-VolumeQuotasNegativeTestJSON-598224028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:02:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c213ac8a-84fc-4e9e-8e45-358f51830d5e tempest-VolumeQuotasNegativeTestJSON-598224028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:02:59 devstack sudo[92235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:02:59 devstack sudo[92235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:02:59 devstack sudo[92235]: pam_unix(sudo:session): session closed for user root
Sep 07 18:02:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c213ac8a-84fc-4e9e-8e45-358f51830d5e tempest-VolumeQuotasNegativeTestJSON-598224028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.287s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:02:59 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-c213ac8a-84fc-4e9e-8e45-358f51830d5e tempest-VolumeQuotasNegativeTestJSON-598224028 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:02:59 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-c213ac8a-84fc-4e9e-8e45-358f51830d5e tempest-VolumeQuotasNegativeTestJSON-598224028 None] Deleted volume successfully.
Sep 07 18:02:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c213ac8a-84fc-4e9e-8e45-358f51830d5e tempest-VolumeQuotasNegativeTestJSON-598224028 None] Lock "cinder-31f9c943-1011-44df-83bb-a008ff275977-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:03:00 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:03:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Flow 'volume_create_manager' (becfe1d3-f8ec-4840-90af-2807557a2c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:03:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6c87785-89f8-47d4-ad6f-5a0fbb97b13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:00 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:03:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:03:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:03:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:03:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:03:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:03:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6c87785-89f8-47d4-ad6f-5a0fbb97b13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1287646141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec5c863-33cc-44f1-b8a0-b375740f7959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80c182c250804a089f6927e435263758',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:03:01Z,use_quota=True,user_id='2da1dfa9a9f542efa5fca89596934fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d22a7ad3-fb97-443e-9e1b-fa35501a82de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:00 devstack sudo[92238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:03:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d22a7ad3-fb97-443e-9e1b-fa35501a82de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:00 devstack sudo[92238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf742c44-dbbb-4b80-9813-47e7948b71d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:00 devstack cinder-volume[87269]: DEBUG cinder.image.glance [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Creating Keystone auth plugin from conf {{(pid=87269) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 07 18:03:01 devstack sudo[92238]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.373s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:03:01 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:03:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread count: 8 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 07 18:03:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread info: [<_MainThread(MainThread, started 137533762306176)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137533650971072)>, <Thread(Thread-3 (stat_writer), started daemon 137533647226880)>, <Thread(Rabbit-heartbeat, started daemon 137533647437120)>, <Thread(Thread-5 (_runner), started daemon 137533648120896)>, <Thread(Thread-7 (_runner), started daemon 137533648182592)>, <Thread(fd_logger, started daemon 137533644336576)>, <Thread(privsep_reader, started daemon 137533643255424)>] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 07 18:03:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf742c44-dbbb-4b80-9813-47e7948b71d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9ec5c863-33cc-44f1-b8a0-b375740f7959', 'volume_name': 'volume-9ec5c863-33cc-44f1-b8a0-b375740f7959', 'volume_size': 1, 'image_id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72845066d7f346c6b304e9cfe8bcc9a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'created_at': datetime.datetime(2026, 9, 7, 15, 54, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d160b920da0>}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c571178-647d-427b-b148-727c489741a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c571178-647d-427b-b148-727c489741a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a856aea3-c11a-465a-b29e-7001546c4deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:02 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Volume 9ec5c863-33cc-44f1-b8a0-b375740f7959: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9ec5c863-33cc-44f1-b8a0-b375740f7959', 'volume_size': 1, 'image_id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72845066d7f346c6b304e9cfe8bcc9a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'created_at': datetime.datetime(2026, 9, 7, 15, 54, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d160b920da0>}
Sep 07 18:03:02 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Trying to clone 9ec5c863-33cc-44f1-b8a0-b375740f7959 from image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}]). {{(pid=87269) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 07 18:03:02 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_je1txphudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 07 18:03:02 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Image download 20.69 MB at 20.69 MB/s
Sep 07 18:03:02 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1272edd-7f49-4590-b0f8-467b995d7438]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:03:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_je1txphudevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:02 devstack sudo[92277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_je1txphudevstack@QuobyteHD
Sep 07 18:03:02 devstack sudo[92277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:03 devstack sudo[92277]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_je1txphudevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:03 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Temporary image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 is fetched for user 2da1dfa9a9f542efa5fca89596934fc5. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 07 18:03:03 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a042e3cb-fcd6-4d71-ba84-9b0d8380497d]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:03:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_je1txphudevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:03 devstack sudo[92282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_je1txphudevstack@QuobyteHD
Sep 07 18:03:03 devstack sudo[92282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:03 devstack sudo[92282]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_je1txphudevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:03:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:03:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1287646141',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec5c863-33cc-44f1-b8a0-b375740f7959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80c182c250804a089f6927e435263758',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:03:01Z,use_quota=True,user_id='2da1dfa9a9f542efa5fca89596934fc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:03:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Creating volume 9ec5c863-33cc-44f1-b8a0-b375740f7959 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:03:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:03:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:03:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:03:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:03:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:03:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:03:03 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:03:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ec5c863-33cc-44f1-b8a0-b375740f7959 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:03 devstack sudo[92288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ec5c863-33cc-44f1-b8a0-b375740f7959 1073741824
Sep 07 18:03:03 devstack sudo[92288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:04 devstack sudo[92288]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ec5c863-33cc-44f1-b8a0-b375740f7959 1073741824" returned: 0 in 0.472s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ec5c863-33cc-44f1-b8a0-b375740f7959 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:04 devstack sudo[92295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ec5c863-33cc-44f1-b8a0-b375740f7959
Sep 07 18:03:04 devstack sudo[92295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:04 devstack sudo[92295]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ec5c863-33cc-44f1-b8a0-b375740f7959" returned: 0 in 0.279s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:03:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:03:04 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Attempting download of 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 ((None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}])) to volume 9ec5c863-33cc-44f1-b8a0-b375740f7959. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 07 18:03:04 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb79bed0-6c71-45e1-a1ee-d6779c737758]: (4, 'raw') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:03:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_8l18sl7r {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:04 devstack sudo[92298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_8l18sl7r
Sep 07 18:03:04 devstack sudo[92298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:04 devstack sudo[92298]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_8l18sl7r" returned: 0 in 0.346s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_8l18sl7r {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:05 devstack sudo[92302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_8l18sl7r
Sep 07 18:03:05 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:05 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_8l18sl7r" returned: 1 in 0.376s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_8l18sl7r' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 07 18:03:05 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6690272-3def-42a7-8170-b67f5d11e682]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:03:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_je1txphudevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:05 devstack sudo[92306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_je1txphudevstack@QuobyteHD
Sep 07 18:03:05 devstack sudo[92306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:05 devstack sudo[92306]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_je1txphudevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:05 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 was qcow2, converting to qcow2 {{(pid=87269) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 07 18:03:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_je1txphudevstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ec5c863-33cc-44f1-b8a0-b375740f7959 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:05 devstack sudo[92314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_je1txphudevstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ec5c863-33cc-44f1-b8a0-b375740f7959
Sep 07 18:03:05 devstack sudo[92314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:07 devstack sudo[92314]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_je1txphudevstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ec5c863-33cc-44f1-b8a0-b375740f7959" returned: 0 in 2.042s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:07 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_je1txphudevstack@QuobyteHD, size 112.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ec5c863-33cc-44f1-b8a0-b375740f7959 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 07 18:03:07 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Converted 112.00 MB image at 54.80 MB/s
Sep 07 18:03:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ec5c863-33cc-44f1-b8a0-b375740f7959 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:07 devstack sudo[92322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ec5c863-33cc-44f1-b8a0-b375740f7959 1G
Sep 07 18:03:07 devstack sudo[92322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:08 devstack sudo[92322]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ec5c863-33cc-44f1-b8a0-b375740f7959 1G" returned: 0 in 0.369s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:08 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Downloaded image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 ((None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}])) to volume 9ec5c863-33cc-44f1-b8a0-b375740f7959 successfully. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 07 18:03:08 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Temporary image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 for user 2da1dfa9a9f542efa5fca89596934fc5 is deleted. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 07 18:03:08 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Marking volume 9ec5c863-33cc-44f1-b8a0-b375740f7959 as bootable. {{(pid=87269) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 07 18:03:08 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=96,cinder:UPDATE=106,cinder:INSERT=22,cinder:DELETE=5 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:03:08 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Copying metadata from image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 to 9ec5c863-33cc-44f1-b8a0-b375740f7959. {{(pid=87269) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 07 18:03:08 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Creating volume glance metadata for volume 9ec5c863-33cc-44f1-b8a0-b375740f7959 backed by image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87269) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 07 18:03:08 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=106,cinder:SELECT=109,cinder:INSERT=31,cinder:DELETE=11 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:03:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a856aea3-c11a-465a-b29e-7001546c4deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ec5c863-33cc-44f1-b8a0-b375740f7959', 'volume_size': 1, 'image_id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72845066d7f346c6b304e9cfe8bcc9a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'created_at': datetime.datetime(2026, 9, 7, 15, 54, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d160b920da0>}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c105c0-0baf-48b0-9d2c-0f53dcbec117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:08 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Volume volume-9ec5c863-33cc-44f1-b8a0-b375740f7959 (9ec5c863-33cc-44f1-b8a0-b375740f7959): created successfully
Sep 07 18:03:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34c105c0-0baf-48b0-9d2c-0f53dcbec117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Flow 'volume_create_manager' (becfe1d3-f8ec-4840-90af-2807557a2c25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:03:08 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-fec9ec1f-d6bb-4f92-ab1c-390c9bc3f6b6 tempest-ServerActionsTestOtherA-1043843369 None] Created volume successfully.
Sep 07 18:03:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-ecfa166c-b32f-437f-9862-b3ba74186e6c req-18b80ea1-e237-4b7c-98ca-cbb087b3e6a2 tempest-ServerActionsTestOtherA-1043843369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:03:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-ecfa166c-b32f-437f-9862-b3ba74186e6c req-18b80ea1-e237-4b7c-98ca-cbb087b3e6a2 tempest-ServerActionsTestOtherA-1043843369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:03:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-ecfa166c-b32f-437f-9862-b3ba74186e6c req-18b80ea1-e237-4b7c-98ca-cbb087b3e6a2 tempest-ServerActionsTestOtherA-1043843369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:03:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-ecfa166c-b32f-437f-9862-b3ba74186e6c req-18b80ea1-e237-4b7c-98ca-cbb087b3e6a2 tempest-ServerActionsTestOtherA-1043843369 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d', 'name': 'volume-9ec5c863-33cc-44f1-b8a0-b375740f7959', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '76e4b06d-7b56-4846-86de-919e78d8b417', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 07 18:03:12 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-ecfa166c-b32f-437f-9862-b3ba74186e6c req-18b80ea1-e237-4b7c-98ca-cbb087b3e6a2 tempest-ServerActionsTestOtherA-1043843369 None] attachment_update completed successfully.
Sep 07 18:03:13 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:03:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Flow 'volume_create_manager' (df5c82cb-87f6-4016-a1b2-6aa67b4126b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:03:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fba9b20-0049-48cc-8e80-4f7d3a0218c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fba9b20-0049-48cc-8e80-4f7d3a0218c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-348036951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bae9a47-665f-483a-ac78-93d171141ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85fae6fc5a984195b885113b202c7d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:03:14Z,use_quota=True,user_id='46e1c75cede042baaf0c1704f089e208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd256d02-8ba8-4dee-8bbe-ee0c80ef99bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd256d02-8ba8-4dee-8bbe-ee0c80ef99bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f6c335-7eb0-484e-a593-aa765e576f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2f6c335-7eb0-484e-a593-aa765e576f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bae9a47-665f-483a-ac78-93d171141ed0', 'volume_name': 'volume-8bae9a47-665f-483a-ac78-93d171141ed0', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcccd225-b832-4660-bcd8-f286db4af70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcccd225-b832-4660-bcd8-f286db4af70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aafe38c2-ae1f-4c90-a8f2-5615e42d0014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:13 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Volume 8bae9a47-665f-483a-ac78-93d171141ed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bae9a47-665f-483a-ac78-93d171141ed0', 'volume_size': 1}
Sep 07 18:03:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:03:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:03:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-348036951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bae9a47-665f-483a-ac78-93d171141ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85fae6fc5a984195b885113b202c7d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:03:14Z,use_quota=True,user_id='46e1c75cede042baaf0c1704f089e208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:03:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Creating volume 8bae9a47-665f-483a-ac78-93d171141ed0 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:03:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:03:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:03:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:03:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:03:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:03:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:03:13 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:03:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8bae9a47-665f-483a-ac78-93d171141ed0 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:13 devstack sudo[92347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8bae9a47-665f-483a-ac78-93d171141ed0 1073741824
Sep 07 18:03:13 devstack sudo[92347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:14 devstack sudo[92347]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8bae9a47-665f-483a-ac78-93d171141ed0 1073741824" returned: 0 in 0.618s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8bae9a47-665f-483a-ac78-93d171141ed0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:14 devstack sudo[92355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8bae9a47-665f-483a-ac78-93d171141ed0
Sep 07 18:03:14 devstack sudo[92355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:14 devstack sudo[92355]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8bae9a47-665f-483a-ac78-93d171141ed0" returned: 0 in 0.346s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:03:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:03:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aafe38c2-ae1f-4c90-a8f2-5615e42d0014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bae9a47-665f-483a-ac78-93d171141ed0', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29342e43-905f-4475-ba15-46e1968014c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:14 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Volume volume-8bae9a47-665f-483a-ac78-93d171141ed0 (8bae9a47-665f-483a-ac78-93d171141ed0): created successfully
Sep 07 18:03:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29342e43-905f-4475-ba15-46e1968014c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Flow 'volume_create_manager' (df5c82cb-87f6-4016-a1b2-6aa67b4126b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:03:14 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a9772077-5827-4929-bca1-d37a0f833a47 tempest-AttachVolumeTestJSON-728677255 None] Created volume successfully.
Sep 07 18:03:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-23af50b3-9a87-41fc-a8be-01ec1b9eb9f8 req-841a957a-cfa2-490d-8650-0ae9bd036131 tempest-AttachVolumeTestJSON-728677255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:03:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-23af50b3-9a87-41fc-a8be-01ec1b9eb9f8 req-841a957a-cfa2-490d-8650-0ae9bd036131 tempest-AttachVolumeTestJSON-728677255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:03:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-23af50b3-9a87-41fc-a8be-01ec1b9eb9f8 req-841a957a-cfa2-490d-8650-0ae9bd036131 tempest-AttachVolumeTestJSON-728677255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:03:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-23af50b3-9a87-41fc-a8be-01ec1b9eb9f8 req-841a957a-cfa2-490d-8650-0ae9bd036131 tempest-AttachVolumeTestJSON-728677255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d', 'name': 'volume-8bae9a47-665f-483a-ac78-93d171141ed0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92befb1a-9445-4c70-84f7-a2a1d7f8a216', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 07 18:03:17 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-23af50b3-9a87-41fc-a8be-01ec1b9eb9f8 req-841a957a-cfa2-490d-8650-0ae9bd036131 tempest-AttachVolumeTestJSON-728677255 None] attachment_update completed successfully.
Sep 07 18:03:19 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:03:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Flow 'volume_create_manager' (8b4382b6-baa2-43d3-bb07-65544a946dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:03:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a17a4b75-e24f-4af6-b61d-920c86792d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a17a4b75-e24f-4af6-b61d-920c86792d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2144966138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=727c82cb-95df-4a42-97aa-8aa8228cf08e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a47ce316ca42c6b63bc1d53196324c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:03:19Z,use_quota=True,user_id='b1f56d563d2c40d9a1497c3e2d90485d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f98df14d-98af-4dca-add6-8d27cc55ca72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f98df14d-98af-4dca-add6-8d27cc55ca72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ccad5c-8409-4f03-99d7-e558d473a97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:19 devstack cinder-volume[87269]: DEBUG cinder.image.glance [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Creating Keystone auth plugin from conf {{(pid=87269) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 07 18:03:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31ccad5c-8409-4f03-99d7-e558d473a97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '727c82cb-95df-4a42-97aa-8aa8228cf08e', 'volume_name': 'volume-727c82cb-95df-4a42-97aa-8aa8228cf08e', 'volume_size': 1, 'image_id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72845066d7f346c6b304e9cfe8bcc9a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'created_at': datetime.datetime(2026, 9, 7, 15, 54, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d160b8e8920>}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b58f9b-450f-4e1f-9f86-97e5156ea231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b58f9b-450f-4e1f-9f86-97e5156ea231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd046a9-a8b0-4f51-be43-ed99e8911ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:19 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Volume 727c82cb-95df-4a42-97aa-8aa8228cf08e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-727c82cb-95df-4a42-97aa-8aa8228cf08e', 'volume_size': 1, 'image_id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72845066d7f346c6b304e9cfe8bcc9a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'created_at': datetime.datetime(2026, 9, 7, 15, 54, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d160b8e8920>}
Sep 07 18:03:19 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Trying to clone 727c82cb-95df-4a42-97aa-8aa8228cf08e from image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}]). {{(pid=87269) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 07 18:03:20 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_bfgz1ql2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 07 18:03:20 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Image download 20.69 MB at 20.69 MB/s
Sep 07 18:03:20 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[60433162-aba9-43dd-b26d-a1f3a1683ac0]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:03:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_bfgz1ql2devstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:20 devstack sudo[92808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_bfgz1ql2devstack@QuobyteHD
Sep 07 18:03:20 devstack sudo[92808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:21 devstack sudo[92808]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_bfgz1ql2devstack@QuobyteHD" returned: 0 in 0.601s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:21 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Temporary image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 is fetched for user b1f56d563d2c40d9a1497c3e2d90485d. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 07 18:03:21 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b0ea3d-e93a-4418-ac87-0f2344123552]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:03:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_bfgz1ql2devstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:21 devstack sudo[92813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_bfgz1ql2devstack@QuobyteHD
Sep 07 18:03:21 devstack sudo[92813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:21 devstack sudo[92813]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_bfgz1ql2devstack@QuobyteHD" returned: 0 in 0.554s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:03:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:03:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2144966138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=727c82cb-95df-4a42-97aa-8aa8228cf08e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70a47ce316ca42c6b63bc1d53196324c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:03:19Z,use_quota=True,user_id='b1f56d563d2c40d9a1497c3e2d90485d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:03:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Creating volume 727c82cb-95df-4a42-97aa-8aa8228cf08e {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:03:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:03:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:03:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:03:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:03:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:03:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:03:21 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:03:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-727c82cb-95df-4a42-97aa-8aa8228cf08e 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:21 devstack sudo[92818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-727c82cb-95df-4a42-97aa-8aa8228cf08e 1073741824
Sep 07 18:03:21 devstack sudo[92818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:22 devstack sudo[92818]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-727c82cb-95df-4a42-97aa-8aa8228cf08e 1073741824" returned: 0 in 0.859s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-727c82cb-95df-4a42-97aa-8aa8228cf08e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:22 devstack sudo[92831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-727c82cb-95df-4a42-97aa-8aa8228cf08e
Sep 07 18:03:22 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:23 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-727c82cb-95df-4a42-97aa-8aa8228cf08e" returned: 0 in 0.382s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:03:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.320s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:03:23 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Attempting download of 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 ((None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}])) to volume 727c82cb-95df-4a42-97aa-8aa8228cf08e. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 07 18:03:23 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2dc4f8-b7ad-4e5f-89c6-dbd3219daaf7]: (4, 'raw') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:03:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_v5ga38_p {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:23 devstack sudo[92834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_v5ga38_p
Sep 07 18:03:23 devstack sudo[92834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:24 devstack sudo[92834]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_v5ga38_p" returned: 0 in 0.703s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_v5ga38_p {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:24 devstack sudo[92843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_v5ga38_p
Sep 07 18:03:24 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:24 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_v5ga38_p" returned: 1 in 0.682s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_v5ga38_p' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 07 18:03:24 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1272c13-7bb6-4445-92ae-f7576af11c87]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:03:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_bfgz1ql2devstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:24 devstack sudo[92848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_bfgz1ql2devstack@QuobyteHD
Sep 07 18:03:24 devstack sudo[92848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:25 devstack sudo[92848]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_bfgz1ql2devstack@QuobyteHD" returned: 0 in 0.460s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:25 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 was qcow2, converting to qcow2 {{(pid=87269) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 07 18:03:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_bfgz1ql2devstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-727c82cb-95df-4a42-97aa-8aa8228cf08e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:25 devstack sudo[92853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_bfgz1ql2devstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-727c82cb-95df-4a42-97aa-8aa8228cf08e
Sep 07 18:03:25 devstack sudo[92853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:27 devstack sudo[92853]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_bfgz1ql2devstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-727c82cb-95df-4a42-97aa-8aa8228cf08e" returned: 0 in 2.710s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:27 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_bfgz1ql2devstack@QuobyteHD, size 112.00 MB, duration 2.71 sec, destination /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-727c82cb-95df-4a42-97aa-8aa8228cf08e {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 07 18:03:27 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Converted 112.00 MB image at 41.30 MB/s
Sep 07 18:03:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-727c82cb-95df-4a42-97aa-8aa8228cf08e 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:28 devstack sudo[92864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-727c82cb-95df-4a42-97aa-8aa8228cf08e 1G
Sep 07 18:03:28 devstack sudo[92864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:28 devstack sudo[92864]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-727c82cb-95df-4a42-97aa-8aa8228cf08e 1G" returned: 0 in 0.592s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:28 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Downloaded image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 ((None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}])) to volume 727c82cb-95df-4a42-97aa-8aa8228cf08e successfully. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 07 18:03:28 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Temporary image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 for user b1f56d563d2c40d9a1497c3e2d90485d is deleted. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 07 18:03:28 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Marking volume 727c82cb-95df-4a42-97aa-8aa8228cf08e as bootable. {{(pid=87269) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 07 18:03:28 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Copying metadata from image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 to 727c82cb-95df-4a42-97aa-8aa8228cf08e. {{(pid=87269) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 07 18:03:28 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Creating volume glance metadata for volume 727c82cb-95df-4a42-97aa-8aa8228cf08e backed by image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87269) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 07 18:03:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd046a9-a8b0-4f51-be43-ed99e8911ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-727c82cb-95df-4a42-97aa-8aa8228cf08e', 'volume_size': 1, 'image_id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72845066d7f346c6b304e9cfe8bcc9a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'created_at': datetime.datetime(2026, 9, 7, 15, 54, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d160b8e8920>}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c2ea442-b4db-4212-976e-a63a08eca970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:28 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Volume volume-727c82cb-95df-4a42-97aa-8aa8228cf08e (727c82cb-95df-4a42-97aa-8aa8228cf08e): created successfully
Sep 07 18:03:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c2ea442-b4db-4212-976e-a63a08eca970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Flow 'volume_create_manager' (8b4382b6-baa2-43d3-bb07-65544a946dcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:03:28 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-8be8923d-8823-417d-8fa2-ab4c026e3bfe tempest-VolumesImageMetadata-149870152 None] Created volume successfully.
Sep 07 18:03:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7dbcb715-e367-4cfe-9291-10196d16f24e tempest-VolumesImageMetadata-149870152 None] Acquiring lock "cinder-727c82cb-95df-4a42-97aa-8aa8228cf08e-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:03:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7dbcb715-e367-4cfe-9291-10196d16f24e tempest-VolumesImageMetadata-149870152 None] Lock "cinder-727c82cb-95df-4a42-97aa-8aa8228cf08e-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:03:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7dbcb715-e367-4cfe-9291-10196d16f24e tempest-VolumesImageMetadata-149870152 None] Acquiring lock "cinder-quobyte-727c82cb-95df-4a42-97aa-8aa8228cf08e" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:03:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7dbcb715-e367-4cfe-9291-10196d16f24e tempest-VolumesImageMetadata-149870152 None] Lock "cinder-quobyte-727c82cb-95df-4a42-97aa-8aa8228cf08e" acquired by "delete_volume" :: waited 0.055s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:03:31 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e435b03b-b07b-4dba-8283-4ea3452799cb]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:03:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7dbcb715-e367-4cfe-9291-10196d16f24e tempest-VolumesImageMetadata-149870152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-727c82cb-95df-4a42-97aa-8aa8228cf08e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:31 devstack sudo[92945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-727c82cb-95df-4a42-97aa-8aa8228cf08e
Sep 07 18:03:31 devstack sudo[92945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:32 devstack sudo[92945]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7dbcb715-e367-4cfe-9291-10196d16f24e tempest-VolumesImageMetadata-149870152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-727c82cb-95df-4a42-97aa-8aa8228cf08e" returned: 0 in 0.678s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7dbcb715-e367-4cfe-9291-10196d16f24e tempest-VolumesImageMetadata-149870152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-727c82cb-95df-4a42-97aa-8aa8228cf08e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:32 devstack sudo[92970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-727c82cb-95df-4a42-97aa-8aa8228cf08e
Sep 07 18:03:32 devstack sudo[92970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:32 devstack sudo[92970]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7dbcb715-e367-4cfe-9291-10196d16f24e tempest-VolumesImageMetadata-149870152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-727c82cb-95df-4a42-97aa-8aa8228cf08e" returned: 0 in 0.547s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7dbcb715-e367-4cfe-9291-10196d16f24e tempest-VolumesImageMetadata-149870152 None] Lock "cinder-quobyte-727c82cb-95df-4a42-97aa-8aa8228cf08e" released by "delete_volume" :: held 1.360s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:03:32 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-7dbcb715-e367-4cfe-9291-10196d16f24e tempest-VolumesImageMetadata-149870152 None] Created reservations ['27aa967b-2e59-4e2f-8660-72db72833db7', '2341dcde-f409-4837-a390-cb9c0d25ebd3', 'ea618548-6c7a-4635-b124-51494df09f32', 'f22fa905-69fc-44e1-ada4-74fa19d16e09'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:03:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7dbcb715-e367-4cfe-9291-10196d16f24e tempest-VolumesImageMetadata-149870152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:03:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7dbcb715-e367-4cfe-9291-10196d16f24e tempest-VolumesImageMetadata-149870152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:03:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7dbcb715-e367-4cfe-9291-10196d16f24e tempest-VolumesImageMetadata-149870152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:03:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7dbcb715-e367-4cfe-9291-10196d16f24e tempest-VolumesImageMetadata-149870152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:03:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7dbcb715-e367-4cfe-9291-10196d16f24e tempest-VolumesImageMetadata-149870152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:03:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7dbcb715-e367-4cfe-9291-10196d16f24e tempest-VolumesImageMetadata-149870152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:33 devstack sudo[92980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:03:33 devstack sudo[92980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:33 devstack sudo[92980]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7dbcb715-e367-4cfe-9291-10196d16f24e tempest-VolumesImageMetadata-149870152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.670s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:33 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-7dbcb715-e367-4cfe-9291-10196d16f24e tempest-VolumesImageMetadata-149870152 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:03:33 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-7dbcb715-e367-4cfe-9291-10196d16f24e tempest-VolumesImageMetadata-149870152 None] Deleted volume successfully.
Sep 07 18:03:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7dbcb715-e367-4cfe-9291-10196d16f24e tempest-VolumesImageMetadata-149870152 None] Lock "cinder-727c82cb-95df-4a42-97aa-8aa8228cf08e-delete_volume" released by "delete_volume" :: held 2.645s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:03:37 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-66e05eda-27e4-4c6a-acd5-9bb8b8c44e18 req-d8a096af-6afe-462c-88b9-e26b782dcbcf tempest-ServerActionsTestOtherA-1043843369 None] Terminate volume connection completed successfully.
Sep 07 18:03:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-66e05eda-27e4-4c6a-acd5-9bb8b8c44e18 req-d8a096af-6afe-462c-88b9-e26b782dcbcf tempest-ServerActionsTestOtherA-1043843369 None] Deleting attachment 76e4b06d-7b56-4846-86de-919e78d8b417. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 07 18:03:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-66e05eda-27e4-4c6a-acd5-9bb8b8c44e18 req-868ec65c-3396-4a5e-b3d8-d81968f55a81 tempest-ServerActionsTestOtherA-1043843369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:03:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-66e05eda-27e4-4c6a-acd5-9bb8b8c44e18 req-868ec65c-3396-4a5e-b3d8-d81968f55a81 tempest-ServerActionsTestOtherA-1043843369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:03:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-66e05eda-27e4-4c6a-acd5-9bb8b8c44e18 req-868ec65c-3396-4a5e-b3d8-d81968f55a81 tempest-ServerActionsTestOtherA-1043843369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:03:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-66e05eda-27e4-4c6a-acd5-9bb8b8c44e18 req-868ec65c-3396-4a5e-b3d8-d81968f55a81 tempest-ServerActionsTestOtherA-1043843369 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d', 'name': 'volume-9ec5c863-33cc-44f1-b8a0-b375740f7959', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '365e4501-e9ee-441c-9280-aba43f2006e3', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 07 18:03:40 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-66e05eda-27e4-4c6a-acd5-9bb8b8c44e18 req-868ec65c-3396-4a5e-b3d8-d81968f55a81 tempest-ServerActionsTestOtherA-1043843369 None] attachment_update completed successfully.
Sep 07 18:03:41 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:03:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Flow 'volume_create_manager' (10cb6771-dc67-4cb6-9dcd-14e44fdd7306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:03:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18946fdb-d29f-4833-9716-28aa831801c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18946fdb-d29f-4833-9716-28aa831801c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1849688811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3a31382-be40-4560-9981-6bcfe9194966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7999e15126d447a89c46e764bae925ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:03:41Z,use_quota=True,user_id='c3564a4abec842a2836ec5ec87403544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3801f2c-5fec-4655-980b-ffcf324e6cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3801f2c-5fec-4655-980b-ffcf324e6cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4518a540-15ef-48b7-97dc-5492d19fb292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4518a540-15ef-48b7-97dc-5492d19fb292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3a31382-be40-4560-9981-6bcfe9194966', 'volume_name': 'volume-f3a31382-be40-4560-9981-6bcfe9194966', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f38dc40-d7a4-49df-b96c-5cc1c107f9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f38dc40-d7a4-49df-b96c-5cc1c107f9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7601a1cc-e8e0-4b84-875b-4f2c718e957d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:41 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Volume f3a31382-be40-4560-9981-6bcfe9194966: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3a31382-be40-4560-9981-6bcfe9194966', 'volume_size': 1}
Sep 07 18:03:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:03:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:03:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1849688811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3a31382-be40-4560-9981-6bcfe9194966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7999e15126d447a89c46e764bae925ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:03:41Z,use_quota=True,user_id='c3564a4abec842a2836ec5ec87403544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:03:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Creating volume f3a31382-be40-4560-9981-6bcfe9194966 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:03:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:03:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:03:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:03:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:03:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:03:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:03:41 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:03:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f3a31382-be40-4560-9981-6bcfe9194966 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:41 devstack sudo[93099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f3a31382-be40-4560-9981-6bcfe9194966 1073741824
Sep 07 18:03:41 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:42 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f3a31382-be40-4560-9981-6bcfe9194966 1073741824" returned: 0 in 0.874s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f3a31382-be40-4560-9981-6bcfe9194966 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:42 devstack sudo[93116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f3a31382-be40-4560-9981-6bcfe9194966
Sep 07 18:03:42 devstack sudo[93116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:42 devstack sudo[93116]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f3a31382-be40-4560-9981-6bcfe9194966" returned: 0 in 0.353s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:03:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.345s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:03:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7601a1cc-e8e0-4b84-875b-4f2c718e957d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3a31382-be40-4560-9981-6bcfe9194966', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8c142b-e5d5-4fbb-961e-c8cec7b8cda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:42 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Volume volume-f3a31382-be40-4560-9981-6bcfe9194966 (f3a31382-be40-4560-9981-6bcfe9194966): created successfully
Sep 07 18:03:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc8c142b-e5d5-4fbb-961e-c8cec7b8cda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Flow 'volume_create_manager' (10cb6771-dc67-4cb6-9dcd-14e44fdd7306) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:03:42 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-679648ed-587c-46db-81e3-985f67a6be08 tempest-VolumesMetadataTest-1375651223 None] Created volume successfully.
Sep 07 18:03:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d59facd0-dc8d-458c-84ec-df38f65140b2 tempest-VolumesMetadataTest-1375651223 None] Acquiring lock "cinder-f3a31382-be40-4560-9981-6bcfe9194966-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:03:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d59facd0-dc8d-458c-84ec-df38f65140b2 tempest-VolumesMetadataTest-1375651223 None] Lock "cinder-f3a31382-be40-4560-9981-6bcfe9194966-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:03:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d59facd0-dc8d-458c-84ec-df38f65140b2 tempest-VolumesMetadataTest-1375651223 None] Acquiring lock "cinder-quobyte-f3a31382-be40-4560-9981-6bcfe9194966" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:03:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d59facd0-dc8d-458c-84ec-df38f65140b2 tempest-VolumesMetadataTest-1375651223 None] Lock "cinder-quobyte-f3a31382-be40-4560-9981-6bcfe9194966" acquired by "delete_volume" :: waited 0.053s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:03:45 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f497d0-4ed1-46d9-abea-28fc766456e8]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:03:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d59facd0-dc8d-458c-84ec-df38f65140b2 tempest-VolumesMetadataTest-1375651223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f3a31382-be40-4560-9981-6bcfe9194966 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:45 devstack sudo[93123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f3a31382-be40-4560-9981-6bcfe9194966
Sep 07 18:03:45 devstack sudo[93123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:46 devstack sudo[93123]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d59facd0-dc8d-458c-84ec-df38f65140b2 tempest-VolumesMetadataTest-1375651223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f3a31382-be40-4560-9981-6bcfe9194966" returned: 0 in 1.072s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d59facd0-dc8d-458c-84ec-df38f65140b2 tempest-VolumesMetadataTest-1375651223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f3a31382-be40-4560-9981-6bcfe9194966 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:46 devstack sudo[93135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f3a31382-be40-4560-9981-6bcfe9194966
Sep 07 18:03:46 devstack sudo[93135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:47 devstack sudo[93135]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d59facd0-dc8d-458c-84ec-df38f65140b2 tempest-VolumesMetadataTest-1375651223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f3a31382-be40-4560-9981-6bcfe9194966" returned: 0 in 0.528s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d59facd0-dc8d-458c-84ec-df38f65140b2 tempest-VolumesMetadataTest-1375651223 None] Lock "cinder-quobyte-f3a31382-be40-4560-9981-6bcfe9194966" released by "delete_volume" :: held 1.712s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:03:47 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-d59facd0-dc8d-458c-84ec-df38f65140b2 tempest-VolumesMetadataTest-1375651223 None] Created reservations ['61977726-09f6-4953-bb55-afefee11171a', '53a1aa45-98ff-43e5-bc16-92a7cde351f7', 'b958d9aa-041d-4b36-81d3-7d2465ce6557', 'dc67c7af-2ded-411b-a4ad-3f33a83dc63a'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:03:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d59facd0-dc8d-458c-84ec-df38f65140b2 tempest-VolumesMetadataTest-1375651223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:03:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d59facd0-dc8d-458c-84ec-df38f65140b2 tempest-VolumesMetadataTest-1375651223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:03:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d59facd0-dc8d-458c-84ec-df38f65140b2 tempest-VolumesMetadataTest-1375651223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:03:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d59facd0-dc8d-458c-84ec-df38f65140b2 tempest-VolumesMetadataTest-1375651223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:03:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d59facd0-dc8d-458c-84ec-df38f65140b2 tempest-VolumesMetadataTest-1375651223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:03:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d59facd0-dc8d-458c-84ec-df38f65140b2 tempest-VolumesMetadataTest-1375651223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:47 devstack sudo[93139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:03:47 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:47 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d59facd0-dc8d-458c-84ec-df38f65140b2 tempest-VolumesMetadataTest-1375651223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.355s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:47 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-d59facd0-dc8d-458c-84ec-df38f65140b2 tempest-VolumesMetadataTest-1375651223 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:03:47 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d59facd0-dc8d-458c-84ec-df38f65140b2 tempest-VolumesMetadataTest-1375651223 None] Deleted volume successfully.
Sep 07 18:03:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d59facd0-dc8d-458c-84ec-df38f65140b2 tempest-VolumesMetadataTest-1375651223 None] Lock "cinder-f3a31382-be40-4560-9981-6bcfe9194966-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:03:55 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:03:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Flow 'volume_create_manager' (5d93dbff-4ded-4937-b6b3-7f009bb1ee63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:03:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c54232-19ed-4ae7-95f7-bd2bee2780ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c54232-19ed-4ae7-95f7-bd2bee2780ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-515458662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b21a78-2db2-43cd-9525-ebbbd444a04e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3448cf3a5c3d4eb3acbc4c1de6a47865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:03:55Z,use_quota=True,user_id='75a929b0e3db4840be171873c0831d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc57405-808a-40d7-a0e6-b0934326dce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc57405-808a-40d7-a0e6-b0934326dce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d8cac4-99e3-4e98-966f-3dc929a8adf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d8cac4-99e3-4e98-966f-3dc929a8adf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80b21a78-2db2-43cd-9525-ebbbd444a04e', 'volume_name': 'volume-80b21a78-2db2-43cd-9525-ebbbd444a04e', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279b2cd4-a982-4d92-a70f-0df3269d85f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279b2cd4-a982-4d92-a70f-0df3269d85f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53cad14d-72ce-40ef-b3fe-2e6209762f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:55 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Volume 80b21a78-2db2-43cd-9525-ebbbd444a04e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80b21a78-2db2-43cd-9525-ebbbd444a04e', 'volume_size': 1}
Sep 07 18:03:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:03:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:03:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:03:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-515458662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b21a78-2db2-43cd-9525-ebbbd444a04e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3448cf3a5c3d4eb3acbc4c1de6a47865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:03:55Z,use_quota=True,user_id='75a929b0e3db4840be171873c0831d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:03:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Creating volume 80b21a78-2db2-43cd-9525-ebbbd444a04e {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:03:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:03:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:03:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:03:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:03:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:03:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:03:55 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:03:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-80b21a78-2db2-43cd-9525-ebbbd444a04e 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:55 devstack sudo[93165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-80b21a78-2db2-43cd-9525-ebbbd444a04e 1073741824
Sep 07 18:03:55 devstack sudo[93165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:55 devstack sudo[93165]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-80b21a78-2db2-43cd-9525-ebbbd444a04e 1073741824" returned: 0 in 0.664s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-80b21a78-2db2-43cd-9525-ebbbd444a04e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:03:56 devstack sudo[93172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-80b21a78-2db2-43cd-9525-ebbbd444a04e
Sep 07 18:03:56 devstack sudo[93172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:03:56 devstack sudo[93172]: pam_unix(sudo:session): session closed for user root
Sep 07 18:03:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-80b21a78-2db2-43cd-9525-ebbbd444a04e" returned: 0 in 0.316s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:03:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:03:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:03:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53cad14d-72ce-40ef-b3fe-2e6209762f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80b21a78-2db2-43cd-9525-ebbbd444a04e', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b3a2eb-3bf6-49dc-aa36-b58106443baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:03:56 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Volume volume-80b21a78-2db2-43cd-9525-ebbbd444a04e (80b21a78-2db2-43cd-9525-ebbbd444a04e): created successfully
Sep 07 18:03:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32b3a2eb-3bf6-49dc-aa36-b58106443baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:03:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Flow 'volume_create_manager' (5d93dbff-4ded-4937-b6b3-7f009bb1ee63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:03:56 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-6f962d77-278f-4b84-9c98-366b74088753 tempest-VolumesTransfersV355Test-1051304910 None] Created volume successfully.
Sep 07 18:03:58 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-9aa189f5-fc83-4ac6-91b5-cdcdab520282 req-132ecaf4-81f5-44de-8829-2c69c1e19db0 tempest-AttachVolumeTestJSON-728677255 None] Terminate volume connection completed successfully.
Sep 07 18:03:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-9aa189f5-fc83-4ac6-91b5-cdcdab520282 req-132ecaf4-81f5-44de-8829-2c69c1e19db0 tempest-AttachVolumeTestJSON-728677255 None] Deleting attachment 92befb1a-9445-4c70-84f7-a2a1d7f8a216. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 07 18:03:59 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0ee4e474-6fce-4f02-90eb-6cdccfdc73ac tempest-VolumesTransfersV355Test-1515718166 None] Transfer volume completed successfully.
Sep 07 18:04:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-844403a5-9858-444f-b90e-341091d0b3b2 tempest-VolumesTransfersV355Test-164177603 None] Acquiring lock "cinder-80b21a78-2db2-43cd-9525-ebbbd444a04e-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-844403a5-9858-444f-b90e-341091d0b3b2 tempest-VolumesTransfersV355Test-164177603 None] Lock "cinder-80b21a78-2db2-43cd-9525-ebbbd444a04e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-844403a5-9858-444f-b90e-341091d0b3b2 tempest-VolumesTransfersV355Test-164177603 None] Acquiring lock "cinder-quobyte-80b21a78-2db2-43cd-9525-ebbbd444a04e" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-844403a5-9858-444f-b90e-341091d0b3b2 tempest-VolumesTransfersV355Test-164177603 None] Lock "cinder-quobyte-80b21a78-2db2-43cd-9525-ebbbd444a04e" acquired by "delete_volume" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:00 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c9ad4e-7789-43aa-89ac-a75ca5d907bf]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:04:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-844403a5-9858-444f-b90e-341091d0b3b2 tempest-VolumesTransfersV355Test-164177603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-80b21a78-2db2-43cd-9525-ebbbd444a04e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:00 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:04:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:04:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:04:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:00 devstack sudo[93330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:04:00 devstack sudo[93330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:01 devstack sudo[93329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-80b21a78-2db2-43cd-9525-ebbbd444a04e
Sep 07 18:04:01 devstack sudo[93329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:01 devstack sudo[93330]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.324s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:04:01 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:04:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 07 18:04:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread info: [<_MainThread(MainThread, started 137533762306176)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137533650971072)>, <Thread(Thread-3 (stat_writer), started daemon 137533647226880)>, <Thread(Rabbit-heartbeat, started daemon 137533647437120)>, <Thread(Thread-5 (_runner), started daemon 137533648120896)>, <Thread(Thread-7 (_runner), started daemon 137533648182592)>, <Thread(fd_logger, started daemon 137533644336576)>, <Thread(privsep_reader, started daemon 137533643255424)>, <Thread(tpool_thread_0, started daemon 137533635446464)>, <Thread(tpool_thread_1, started daemon 137533627053760)>, <Thread(tpool_thread_2, started daemon 137533618661056)>, <Thread(tpool_thread_3, started daemon 137533610251968)>, <Thread(tpool_thread_4, started daemon 137533601842880)>, <Thread(tpool_thread_5, started daemon 137533593433792)>, <Thread(tpool_thread_6, started daemon 137533585024704)>, <Thread(tpool_thread_7, started daemon 137533576615616)>, <Thread(tpool_thread_8, started daemon 137533568206528)>, <Thread(tpool_thread_9, started daemon 137533559797440)>, <Thread(tpool_thread_10, started daemon 137533551388352)>, <Thread(tpool_thread_11, started daemon 137533542979264)>, <Thread(tpool_thread_12, started daemon 137533534570176)>, <Thread(tpool_thread_13, started daemon 137533526161088)>, <Thread(tpool_thread_14, started daemon 137533517752000)>, <Thread(tpool_thread_15, started daemon 137533509342912)>, <Thread(tpool_thread_16, started daemon 137533500933824)>, <Thread(tpool_thread_17, started daemon 137533492524736)>, <Thread(tpool_thread_18, started daemon 137533484115648)>, <Thread(tpool_thread_19, started daemon 137533475706560)>] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 07 18:04:01 devstack sudo[93329]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-844403a5-9858-444f-b90e-341091d0b3b2 tempest-VolumesTransfersV355Test-164177603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-80b21a78-2db2-43cd-9525-ebbbd444a04e" returned: 0 in 0.876s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-844403a5-9858-444f-b90e-341091d0b3b2 tempest-VolumesTransfersV355Test-164177603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-80b21a78-2db2-43cd-9525-ebbbd444a04e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:01 devstack sudo[93337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-80b21a78-2db2-43cd-9525-ebbbd444a04e
Sep 07 18:04:01 devstack sudo[93337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:01 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:04:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Flow 'volume_create_manager' (f2d6d5d1-126e-4e7d-b582-2944be21eeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:04:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4bb6a5-b9bf-4993-94bb-5c7e4b6eba82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4bb6a5-b9bf-4993-94bb-5c7e4b6eba82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-355037374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9954fba-e48b-4c25-8f74-5fba10c6b48b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e40fbaeb2c946c183603d8ee4ed5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:04:02Z,use_quota=True,user_id='a8b3b23a61084eb1bc7c4e42baf24b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (875a39d8-002f-42fa-9e19-89229c58f9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (875a39d8-002f-42fa-9e19-89229c58f9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece9df99-8b21-4d01-8947-bff026452510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece9df99-8b21-4d01-8947-bff026452510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9954fba-e48b-4c25-8f74-5fba10c6b48b', 'volume_name': 'volume-c9954fba-e48b-4c25-8f74-5fba10c6b48b', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d47831d7-a9e1-412c-a8b6-4b5fdbc0fd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d47831d7-a9e1-412c-a8b6-4b5fdbc0fd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48788dd-389b-4009-9550-bfcfb77b314a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:02 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Volume c9954fba-e48b-4c25-8f74-5fba10c6b48b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9954fba-e48b-4c25-8f74-5fba10c6b48b', 'volume_size': 1}
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-355037374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9954fba-e48b-4c25-8f74-5fba10c6b48b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e40fbaeb2c946c183603d8ee4ed5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:04:02Z,use_quota=True,user_id='a8b3b23a61084eb1bc7c4e42baf24b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Creating volume c9954fba-e48b-4c25-8f74-5fba10c6b48b {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:04:02 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c9954fba-e48b-4c25-8f74-5fba10c6b48b 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:02 devstack sudo[93341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c9954fba-e48b-4c25-8f74-5fba10c6b48b 1073741824
Sep 07 18:04:02 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:02 devstack sudo[93337]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-844403a5-9858-444f-b90e-341091d0b3b2 tempest-VolumesTransfersV355Test-164177603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-80b21a78-2db2-43cd-9525-ebbbd444a04e" returned: 0 in 0.536s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-844403a5-9858-444f-b90e-341091d0b3b2 tempest-VolumesTransfersV355Test-164177603 None] Lock "cinder-quobyte-80b21a78-2db2-43cd-9525-ebbbd444a04e" released by "delete_volume" :: held 1.493s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-844403a5-9858-444f-b90e-341091d0b3b2 tempest-VolumesTransfersV355Test-164177603 None] Created reservations ['2500e1f7-bb2f-4758-af4f-e30711ba19a4', 'f47ad547-1bae-457d-b91f-8cf089f0729b', '62a8a6d8-1cee-41c0-b90c-2fdac46ba065', '6178136f-fdc5-4675-aecb-32817ec121f8'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-844403a5-9858-444f-b90e-341091d0b3b2 tempest-VolumesTransfersV355Test-164177603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-844403a5-9858-444f-b90e-341091d0b3b2 tempest-VolumesTransfersV355Test-164177603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-844403a5-9858-444f-b90e-341091d0b3b2 tempest-VolumesTransfersV355Test-164177603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-844403a5-9858-444f-b90e-341091d0b3b2 tempest-VolumesTransfersV355Test-164177603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-844403a5-9858-444f-b90e-341091d0b3b2 tempest-VolumesTransfersV355Test-164177603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-844403a5-9858-444f-b90e-341091d0b3b2 tempest-VolumesTransfersV355Test-164177603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:02 devstack sudo[93347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:04:02 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:02 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c9954fba-e48b-4c25-8f74-5fba10c6b48b 1073741824" returned: 0 in 0.689s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:02 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-844403a5-9858-444f-b90e-341091d0b3b2 tempest-VolumesTransfersV355Test-164177603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.349s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-844403a5-9858-444f-b90e-341091d0b3b2 tempest-VolumesTransfersV355Test-164177603 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:04:02 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-844403a5-9858-444f-b90e-341091d0b3b2 tempest-VolumesTransfersV355Test-164177603 None] Deleted volume successfully.
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c9954fba-e48b-4c25-8f74-5fba10c6b48b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:02 devstack sudo[93351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c9954fba-e48b-4c25-8f74-5fba10c6b48b
Sep 07 18:04:02 devstack sudo[93351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-844403a5-9858-444f-b90e-341091d0b3b2 tempest-VolumesTransfersV355Test-164177603 None] Lock "cinder-80b21a78-2db2-43cd-9525-ebbbd444a04e-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:03 devstack sudo[93351]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c9954fba-e48b-4c25-8f74-5fba10c6b48b" returned: 0 in 0.397s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:04:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48788dd-389b-4009-9550-bfcfb77b314a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9954fba-e48b-4c25-8f74-5fba10c6b48b', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87791634-11d0-4d08-af5c-75178cb26c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:03 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Volume volume-c9954fba-e48b-4c25-8f74-5fba10c6b48b (c9954fba-e48b-4c25-8f74-5fba10c6b48b): created successfully
Sep 07 18:04:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87791634-11d0-4d08-af5c-75178cb26c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Flow 'volume_create_manager' (f2d6d5d1-126e-4e7d-b582-2944be21eeba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:04:03 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-12981d60-a624-45d3-9237-424767033b3b tempest-VolumesActionsTest-2130616910 None] Created volume successfully.
Sep 07 18:04:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2acd3f74-c55f-4f74-94fc-acd384ebb656 tempest-VolumesActionsTest-2130616910 None] Acquiring lock "cinder-c9954fba-e48b-4c25-8f74-5fba10c6b48b" by "attach_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2acd3f74-c55f-4f74-94fc-acd384ebb656 tempest-VolumesActionsTest-2130616910 None] Lock "cinder-c9954fba-e48b-4c25-8f74-5fba10c6b48b" acquired by "attach_volume" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:04 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:04:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Flow 'volume_create_manager' (2a62efe3-06e1-49b0-83b3-9ed291b0f5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:04:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f55f2df4-15e3-4f55-9f73-345db63786fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f55f2df4-15e3-4f55-9f73-345db63786fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-601200000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5e18240-5841-4474-ad71-0f72db8b8784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3448cf3a5c3d4eb3acbc4c1de6a47865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:04:04Z,use_quota=True,user_id='75a929b0e3db4840be171873c0831d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c092f4-a24a-4f07-b604-08a3f1ec94ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c092f4-a24a-4f07-b604-08a3f1ec94ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d86c34c-b8e0-4a56-979e-9091b7e6d648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d86c34c-b8e0-4a56-979e-9091b7e6d648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5e18240-5841-4474-ad71-0f72db8b8784', 'volume_name': 'volume-a5e18240-5841-4474-ad71-0f72db8b8784', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52d9a22-bdca-4557-8614-8a89f38a4f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e52d9a22-bdca-4557-8614-8a89f38a4f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f138c4b6-fa0a-4827-b78c-3d4e73acc07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:04 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Volume a5e18240-5841-4474-ad71-0f72db8b8784: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5e18240-5841-4474-ad71-0f72db8b8784', 'volume_size': 1}
Sep 07 18:04:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-601200000',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5e18240-5841-4474-ad71-0f72db8b8784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3448cf3a5c3d4eb3acbc4c1de6a47865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:04:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:04:04Z,use_quota=True,user_id='75a929b0e3db4840be171873c0831d01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:04:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Creating volume a5e18240-5841-4474-ad71-0f72db8b8784 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:04:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:04:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:04:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:04:04 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:04:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a5e18240-5841-4474-ad71-0f72db8b8784 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:04 devstack sudo[93380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a5e18240-5841-4474-ad71-0f72db8b8784 1073741824
Sep 07 18:04:04 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:04 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2acd3f74-c55f-4f74-94fc-acd384ebb656 tempest-VolumesActionsTest-2130616910 None] Attaching volume c9954fba-e48b-4c25-8f74-5fba10c6b48b to instance b6647939-8e3b-4c49-affd-aa52e27f9518 at mountpoint /dev/vdb on host None.
Sep 07 18:04:04 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2acd3f74-c55f-4f74-94fc-acd384ebb656 tempest-VolumesActionsTest-2130616910 None] Attach volume completed successfully.
Sep 07 18:04:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2acd3f74-c55f-4f74-94fc-acd384ebb656 tempest-VolumesActionsTest-2130616910 None] Lock "cinder-c9954fba-e48b-4c25-8f74-5fba10c6b48b" released by "attach_volume" :: held 0.354s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:05 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a5e18240-5841-4474-ad71-0f72db8b8784 1073741824" returned: 0 in 0.925s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a5e18240-5841-4474-ad71-0f72db8b8784 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:05 devstack sudo[93441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a5e18240-5841-4474-ad71-0f72db8b8784
Sep 07 18:04:05 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:05 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ca9d103a-d71a-4f1d-9b29-6d5dc44a55ed tempest-VolumesActionsTest-1560007546 None] Terminate volume connection completed successfully.
Sep 07 18:04:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ca9d103a-d71a-4f1d-9b29-6d5dc44a55ed tempest-VolumesActionsTest-1560007546 None] Acquiring lock "cinder-c9954fba-e48b-4c25-8f74-5fba10c6b48b-detach_volume" by "detach_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ca9d103a-d71a-4f1d-9b29-6d5dc44a55ed tempest-VolumesActionsTest-1560007546 None] Lock "cinder-c9954fba-e48b-4c25-8f74-5fba10c6b48b-detach_volume" acquired by "detach_volume" :: waited 0.041s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:05 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ca9d103a-d71a-4f1d-9b29-6d5dc44a55ed tempest-VolumesActionsTest-1560007546 None] Detaching volume c9954fba-e48b-4c25-8f74-5fba10c6b48b from instance b6647939-8e3b-4c49-affd-aa52e27f9518.
Sep 07 18:04:05 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ca9d103a-d71a-4f1d-9b29-6d5dc44a55ed tempest-VolumesActionsTest-1560007546 None] Detach volume completed successfully.
Sep 07 18:04:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ca9d103a-d71a-4f1d-9b29-6d5dc44a55ed tempest-VolumesActionsTest-1560007546 None] Lock "cinder-c9954fba-e48b-4c25-8f74-5fba10c6b48b-detach_volume" released by "detach_volume" :: held 0.202s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:06 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a5e18240-5841-4474-ad71-0f72db8b8784" returned: 0 in 0.862s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:04:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.910s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f138c4b6-fa0a-4827-b78c-3d4e73acc07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5e18240-5841-4474-ad71-0f72db8b8784', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35a5d38-daf2-45ae-8fee-36df5d038c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:06 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Volume volume-a5e18240-5841-4474-ad71-0f72db8b8784 (a5e18240-5841-4474-ad71-0f72db8b8784): created successfully
Sep 07 18:04:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35a5d38-daf2-45ae-8fee-36df5d038c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Flow 'volume_create_manager' (2a62efe3-06e1-49b0-83b3-9ed291b0f5e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:04:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-eb5365f7-c143-4218-87f0-485ae88a8480 tempest-VolumesActionsTest-2130616910 None] Acquiring lock "cinder-c9954fba-e48b-4c25-8f74-5fba10c6b48b-detach_volume" by "detach_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:06 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ab0e497f-2ccf-46d1-8be2-04b0609c21a4 tempest-VolumesTransfersV355Test-1051304910 None] Created volume successfully.
Sep 07 18:04:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-eb5365f7-c143-4218-87f0-485ae88a8480 tempest-VolumesActionsTest-2130616910 None] Lock "cinder-c9954fba-e48b-4c25-8f74-5fba10c6b48b-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:06 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-eb5365f7-c143-4218-87f0-485ae88a8480 tempest-VolumesActionsTest-2130616910 None] Volume detach called, but volume not attached.
Sep 07 18:04:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-eb5365f7-c143-4218-87f0-485ae88a8480 tempest-VolumesActionsTest-2130616910 None] Lock "cinder-c9954fba-e48b-4c25-8f74-5fba10c6b48b-detach_volume" released by "detach_volume" :: held 0.016s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d35bbb32-d149-4980-b7da-1b318e6cc5e1 tempest-VolumesActionsTest-2130616910 None] Acquiring lock "cinder-c9954fba-e48b-4c25-8f74-5fba10c6b48b-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d35bbb32-d149-4980-b7da-1b318e6cc5e1 tempest-VolumesActionsTest-2130616910 None] Lock "cinder-c9954fba-e48b-4c25-8f74-5fba10c6b48b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d35bbb32-d149-4980-b7da-1b318e6cc5e1 tempest-VolumesActionsTest-2130616910 None] Acquiring lock "cinder-quobyte-c9954fba-e48b-4c25-8f74-5fba10c6b48b" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d35bbb32-d149-4980-b7da-1b318e6cc5e1 tempest-VolumesActionsTest-2130616910 None] Lock "cinder-quobyte-c9954fba-e48b-4c25-8f74-5fba10c6b48b" acquired by "delete_volume" :: waited 0.038s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:06 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e5db87-ef86-4336-8ac1-2b78910ffb14]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:04:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d35bbb32-d149-4980-b7da-1b318e6cc5e1 tempest-VolumesActionsTest-2130616910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c9954fba-e48b-4c25-8f74-5fba10c6b48b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:06 devstack sudo[93464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c9954fba-e48b-4c25-8f74-5fba10c6b48b
Sep 07 18:04:06 devstack sudo[93464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:07 devstack sudo[93464]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d35bbb32-d149-4980-b7da-1b318e6cc5e1 tempest-VolumesActionsTest-2130616910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c9954fba-e48b-4c25-8f74-5fba10c6b48b" returned: 0 in 0.395s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d35bbb32-d149-4980-b7da-1b318e6cc5e1 tempest-VolumesActionsTest-2130616910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c9954fba-e48b-4c25-8f74-5fba10c6b48b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:07 devstack sudo[93470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c9954fba-e48b-4c25-8f74-5fba10c6b48b
Sep 07 18:04:07 devstack sudo[93470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:07 devstack sudo[93470]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d35bbb32-d149-4980-b7da-1b318e6cc5e1 tempest-VolumesActionsTest-2130616910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c9954fba-e48b-4c25-8f74-5fba10c6b48b" returned: 0 in 0.421s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d35bbb32-d149-4980-b7da-1b318e6cc5e1 tempest-VolumesActionsTest-2130616910 None] Lock "cinder-quobyte-c9954fba-e48b-4c25-8f74-5fba10c6b48b" released by "delete_volume" :: held 0.884s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:07 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-d35bbb32-d149-4980-b7da-1b318e6cc5e1 tempest-VolumesActionsTest-2130616910 None] Created reservations ['db82f02c-81ee-4f2a-8514-8fa6094505e9', '04b3b663-670e-4ba4-a879-19344be5b82d', 'eaf8d073-0683-4a4d-9d14-abf37bc166ac', '173a1711-d615-4edb-a086-e35bf0cf4c9f'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:04:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d35bbb32-d149-4980-b7da-1b318e6cc5e1 tempest-VolumesActionsTest-2130616910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d35bbb32-d149-4980-b7da-1b318e6cc5e1 tempest-VolumesActionsTest-2130616910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d35bbb32-d149-4980-b7da-1b318e6cc5e1 tempest-VolumesActionsTest-2130616910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:04:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d35bbb32-d149-4980-b7da-1b318e6cc5e1 tempest-VolumesActionsTest-2130616910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:04:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d35bbb32-d149-4980-b7da-1b318e6cc5e1 tempest-VolumesActionsTest-2130616910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d35bbb32-d149-4980-b7da-1b318e6cc5e1 tempest-VolumesActionsTest-2130616910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5f0478bf-b004-4e02-883b-4522991fa151 tempest-VolumesTransfersV355Test-164177603 None] Acquiring lock "cinder-a5e18240-5841-4474-ad71-0f72db8b8784-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5f0478bf-b004-4e02-883b-4522991fa151 tempest-VolumesTransfersV355Test-164177603 None] Lock "cinder-a5e18240-5841-4474-ad71-0f72db8b8784-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:07 devstack sudo[93473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:04:07 devstack sudo[93473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5f0478bf-b004-4e02-883b-4522991fa151 tempest-VolumesTransfersV355Test-164177603 None] Acquiring lock "cinder-quobyte-a5e18240-5841-4474-ad71-0f72db8b8784" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5f0478bf-b004-4e02-883b-4522991fa151 tempest-VolumesTransfersV355Test-164177603 None] Lock "cinder-quobyte-a5e18240-5841-4474-ad71-0f72db8b8784" acquired by "delete_volume" :: waited 0.061s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:08 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0902eb-68a0-4410-99b8-6f75ef9b6848]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:04:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5f0478bf-b004-4e02-883b-4522991fa151 tempest-VolumesTransfersV355Test-164177603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a5e18240-5841-4474-ad71-0f72db8b8784 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:08 devstack sudo[93473]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d35bbb32-d149-4980-b7da-1b318e6cc5e1 tempest-VolumesActionsTest-2130616910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.503s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:08 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-d35bbb32-d149-4980-b7da-1b318e6cc5e1 tempest-VolumesActionsTest-2130616910 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:04:08 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d35bbb32-d149-4980-b7da-1b318e6cc5e1 tempest-VolumesActionsTest-2130616910 None] Deleted volume successfully.
Sep 07 18:04:08 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=84,cinder:INSERT=30,cinder:UPDATE=60,cinder:DELETE=4 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:04:08 devstack sudo[93476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a5e18240-5841-4474-ad71-0f72db8b8784
Sep 07 18:04:08 devstack sudo[93476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d35bbb32-d149-4980-b7da-1b318e6cc5e1 tempest-VolumesActionsTest-2130616910 None] Lock "cinder-c9954fba-e48b-4c25-8f74-5fba10c6b48b-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:08 devstack sudo[93476]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5f0478bf-b004-4e02-883b-4522991fa151 tempest-VolumesTransfersV355Test-164177603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a5e18240-5841-4474-ad71-0f72db8b8784" returned: 0 in 0.704s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5f0478bf-b004-4e02-883b-4522991fa151 tempest-VolumesTransfersV355Test-164177603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a5e18240-5841-4474-ad71-0f72db8b8784 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:08 devstack sudo[93503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a5e18240-5841-4474-ad71-0f72db8b8784
Sep 07 18:04:08 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:09 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5f0478bf-b004-4e02-883b-4522991fa151 tempest-VolumesTransfersV355Test-164177603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a5e18240-5841-4474-ad71-0f72db8b8784" returned: 0 in 0.370s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5f0478bf-b004-4e02-883b-4522991fa151 tempest-VolumesTransfersV355Test-164177603 None] Lock "cinder-quobyte-a5e18240-5841-4474-ad71-0f72db8b8784" released by "delete_volume" :: held 1.211s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:09 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=69,cinder:INSERT=19,cinder:UPDATE=63,cinder:DELETE=7 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:04:09 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-5f0478bf-b004-4e02-883b-4522991fa151 tempest-VolumesTransfersV355Test-164177603 None] Created reservations ['e5e77def-f21f-4a04-b1d0-e8de492934f2', '6940cd46-c266-4fd1-a777-e387a7ceb77d', '3819f094-d60d-405d-b122-d4fc6ae480d5', 'b57bb2b0-a711-4484-87c5-67442da88cf0'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:04:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5f0478bf-b004-4e02-883b-4522991fa151 tempest-VolumesTransfersV355Test-164177603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5f0478bf-b004-4e02-883b-4522991fa151 tempest-VolumesTransfersV355Test-164177603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5f0478bf-b004-4e02-883b-4522991fa151 tempest-VolumesTransfersV355Test-164177603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:04:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5f0478bf-b004-4e02-883b-4522991fa151 tempest-VolumesTransfersV355Test-164177603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:04:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5f0478bf-b004-4e02-883b-4522991fa151 tempest-VolumesTransfersV355Test-164177603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5f0478bf-b004-4e02-883b-4522991fa151 tempest-VolumesTransfersV355Test-164177603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:09 devstack sudo[93507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:04:09 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:09 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5f0478bf-b004-4e02-883b-4522991fa151 tempest-VolumesTransfersV355Test-164177603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.421s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:09 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-5f0478bf-b004-4e02-883b-4522991fa151 tempest-VolumesTransfersV355Test-164177603 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:04:09 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5f0478bf-b004-4e02-883b-4522991fa151 tempest-VolumesTransfersV355Test-164177603 None] Deleted volume successfully.
Sep 07 18:04:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5f0478bf-b004-4e02-883b-4522991fa151 tempest-VolumesTransfersV355Test-164177603 None] Lock "cinder-a5e18240-5841-4474-ad71-0f72db8b8784-delete_volume" released by "delete_volume" :: held 2.042s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:11 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:04:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Flow 'volume_create_manager' (d2412716-dab8-49ea-ab08-5619e2e500d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:04:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10617a41-7097-46ce-ae4d-3ce1d44890c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10617a41-7097-46ce-ae4d-3ce1d44890c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1022299501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6538395-e50d-416d-9b97-ae68c83482c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e40fbaeb2c946c183603d8ee4ed5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:04:12Z,use_quota=True,user_id='a8b3b23a61084eb1bc7c4e42baf24b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944cc413-81fc-410e-ae13-287461c91964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944cc413-81fc-410e-ae13-287461c91964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd01f91-5fdf-40b9-abe2-b95be4768475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd01f91-5fdf-40b9-abe2-b95be4768475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6538395-e50d-416d-9b97-ae68c83482c6', 'volume_name': 'volume-f6538395-e50d-416d-9b97-ae68c83482c6', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b148edb0-5fab-471f-b4d7-31f30be5130c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b148edb0-5fab-471f-b4d7-31f30be5130c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c46f87-114b-4fd7-87d2-a56b8c4b4059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:12 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Volume f6538395-e50d-416d-9b97-ae68c83482c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6538395-e50d-416d-9b97-ae68c83482c6', 'volume_size': 1}
Sep 07 18:04:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1022299501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6538395-e50d-416d-9b97-ae68c83482c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e40fbaeb2c946c183603d8ee4ed5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:04:12Z,use_quota=True,user_id='a8b3b23a61084eb1bc7c4e42baf24b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:04:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Creating volume f6538395-e50d-416d-9b97-ae68c83482c6 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:04:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:04:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:04:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:04:12 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:04:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f6538395-e50d-416d-9b97-ae68c83482c6 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:12 devstack sudo[93512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f6538395-e50d-416d-9b97-ae68c83482c6 1073741824
Sep 07 18:04:12 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:12 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f6538395-e50d-416d-9b97-ae68c83482c6 1073741824" returned: 0 in 0.770s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f6538395-e50d-416d-9b97-ae68c83482c6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:13 devstack sudo[93520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f6538395-e50d-416d-9b97-ae68c83482c6
Sep 07 18:04:13 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:13 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f6538395-e50d-416d-9b97-ae68c83482c6" returned: 0 in 0.412s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:04:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.314s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c46f87-114b-4fd7-87d2-a56b8c4b4059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6538395-e50d-416d-9b97-ae68c83482c6', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2993606-83f7-473b-b1c8-fa643af874d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:13 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Volume volume-f6538395-e50d-416d-9b97-ae68c83482c6 (f6538395-e50d-416d-9b97-ae68c83482c6): created successfully
Sep 07 18:04:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2993606-83f7-473b-b1c8-fa643af874d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Flow 'volume_create_manager' (d2412716-dab8-49ea-ab08-5619e2e500d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:04:13 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ab41ff96-84d6-42be-9cd0-9fee65f9240e tempest-VolumesActionsTest-2130616910 None] Created volume successfully.
Sep 07 18:04:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6cf82af4-f235-47af-9179-ac564f555031 tempest-VolumesActionsTest-1560007546 None] Acquiring lock "cinder-f6538395-e50d-416d-9b97-ae68c83482c6-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6cf82af4-f235-47af-9179-ac564f555031 tempest-VolumesActionsTest-1560007546 None] Lock "cinder-f6538395-e50d-416d-9b97-ae68c83482c6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6cf82af4-f235-47af-9179-ac564f555031 tempest-VolumesActionsTest-1560007546 None] Acquiring lock "cinder-quobyte-f6538395-e50d-416d-9b97-ae68c83482c6" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6cf82af4-f235-47af-9179-ac564f555031 tempest-VolumesActionsTest-1560007546 None] Lock "cinder-quobyte-f6538395-e50d-416d-9b97-ae68c83482c6" acquired by "delete_volume" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:14 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[638a50f2-5f80-4329-9e38-bf441b520571]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:04:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cf82af4-f235-47af-9179-ac564f555031 tempest-VolumesActionsTest-1560007546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f6538395-e50d-416d-9b97-ae68c83482c6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:14 devstack sudo[93546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f6538395-e50d-416d-9b97-ae68c83482c6
Sep 07 18:04:14 devstack sudo[93546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:15 devstack sudo[93546]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cf82af4-f235-47af-9179-ac564f555031 tempest-VolumesActionsTest-1560007546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f6538395-e50d-416d-9b97-ae68c83482c6" returned: 0 in 0.537s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cf82af4-f235-47af-9179-ac564f555031 tempest-VolumesActionsTest-1560007546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f6538395-e50d-416d-9b97-ae68c83482c6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:15 devstack sudo[93552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f6538395-e50d-416d-9b97-ae68c83482c6
Sep 07 18:04:15 devstack sudo[93552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:15 devstack sudo[93552]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cf82af4-f235-47af-9179-ac564f555031 tempest-VolumesActionsTest-1560007546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f6538395-e50d-416d-9b97-ae68c83482c6" returned: 0 in 0.427s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6cf82af4-f235-47af-9179-ac564f555031 tempest-VolumesActionsTest-1560007546 None] Lock "cinder-quobyte-f6538395-e50d-416d-9b97-ae68c83482c6" released by "delete_volume" :: held 1.036s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:15 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-6cf82af4-f235-47af-9179-ac564f555031 tempest-VolumesActionsTest-1560007546 None] Created reservations ['035f4855-0271-4c2b-aaa0-d6f8fc83b33d', '7f089e0e-222e-49a9-b6d0-f49be54c4681', 'd518a5ae-702a-4f62-a79a-d25c6201da09', '3381c7f9-6b0b-482e-9ec4-c96f64c87e6e'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:04:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6cf82af4-f235-47af-9179-ac564f555031 tempest-VolumesActionsTest-1560007546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6cf82af4-f235-47af-9179-ac564f555031 tempest-VolumesActionsTest-1560007546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6cf82af4-f235-47af-9179-ac564f555031 tempest-VolumesActionsTest-1560007546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:04:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6cf82af4-f235-47af-9179-ac564f555031 tempest-VolumesActionsTest-1560007546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:04:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6cf82af4-f235-47af-9179-ac564f555031 tempest-VolumesActionsTest-1560007546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cf82af4-f235-47af-9179-ac564f555031 tempest-VolumesActionsTest-1560007546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:15 devstack sudo[93558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:04:15 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:16 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cf82af4-f235-47af-9179-ac564f555031 tempest-VolumesActionsTest-1560007546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.289s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:16 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-6cf82af4-f235-47af-9179-ac564f555031 tempest-VolumesActionsTest-1560007546 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:04:16 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-6cf82af4-f235-47af-9179-ac564f555031 tempest-VolumesActionsTest-1560007546 None] Deleted volume successfully.
Sep 07 18:04:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6cf82af4-f235-47af-9179-ac564f555031 tempest-VolumesActionsTest-1560007546 None] Lock "cinder-f6538395-e50d-416d-9b97-ae68c83482c6-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:16 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-6738e3cd-0abc-4b68-9c83-234985d0d1c6 req-351557ce-8558-45b2-b418-ae46ca0e9d36 tempest-ServerActionsTestOtherA-1043843369 None] Terminate volume connection completed successfully.
Sep 07 18:04:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-6738e3cd-0abc-4b68-9c83-234985d0d1c6 req-351557ce-8558-45b2-b418-ae46ca0e9d36 tempest-ServerActionsTestOtherA-1043843369 None] Deleting attachment 365e4501-e9ee-441c-9280-aba43f2006e3. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 07 18:04:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-6738e3cd-0abc-4b68-9c83-234985d0d1c6 req-15043a87-9d6b-4797-a60c-61421421efc5 tempest-ServerActionsTestOtherA-1043843369 None] Acquiring lock "cinder-9ec5c863-33cc-44f1-b8a0-b375740f7959-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-6738e3cd-0abc-4b68-9c83-234985d0d1c6 req-15043a87-9d6b-4797-a60c-61421421efc5 tempest-ServerActionsTestOtherA-1043843369 None] Lock "cinder-9ec5c863-33cc-44f1-b8a0-b375740f7959-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-6738e3cd-0abc-4b68-9c83-234985d0d1c6 req-15043a87-9d6b-4797-a60c-61421421efc5 tempest-ServerActionsTestOtherA-1043843369 None] Acquiring lock "cinder-quobyte-9ec5c863-33cc-44f1-b8a0-b375740f7959" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-6738e3cd-0abc-4b68-9c83-234985d0d1c6 req-15043a87-9d6b-4797-a60c-61421421efc5 tempest-ServerActionsTestOtherA-1043843369 None] Lock "cinder-quobyte-9ec5c863-33cc-44f1-b8a0-b375740f7959" acquired by "delete_volume" :: waited 0.049s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:16 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe28d3d0-5641-47ff-8461-081c9d6f1868]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:04:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-6738e3cd-0abc-4b68-9c83-234985d0d1c6 req-15043a87-9d6b-4797-a60c-61421421efc5 tempest-ServerActionsTestOtherA-1043843369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ec5c863-33cc-44f1-b8a0-b375740f7959 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:17 devstack sudo[93562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ec5c863-33cc-44f1-b8a0-b375740f7959
Sep 07 18:04:17 devstack sudo[93562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:17 devstack sudo[93562]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-6738e3cd-0abc-4b68-9c83-234985d0d1c6 req-15043a87-9d6b-4797-a60c-61421421efc5 tempest-ServerActionsTestOtherA-1043843369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ec5c863-33cc-44f1-b8a0-b375740f7959" returned: 0 in 0.625s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-6738e3cd-0abc-4b68-9c83-234985d0d1c6 req-15043a87-9d6b-4797-a60c-61421421efc5 tempest-ServerActionsTestOtherA-1043843369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ec5c863-33cc-44f1-b8a0-b375740f7959 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:17 devstack sudo[93567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ec5c863-33cc-44f1-b8a0-b375740f7959
Sep 07 18:04:17 devstack sudo[93567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:17 devstack sudo[93567]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-6738e3cd-0abc-4b68-9c83-234985d0d1c6 req-15043a87-9d6b-4797-a60c-61421421efc5 tempest-ServerActionsTestOtherA-1043843369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ec5c863-33cc-44f1-b8a0-b375740f7959" returned: 0 in 0.347s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-6738e3cd-0abc-4b68-9c83-234985d0d1c6 req-15043a87-9d6b-4797-a60c-61421421efc5 tempest-ServerActionsTestOtherA-1043843369 None] Lock "cinder-quobyte-9ec5c863-33cc-44f1-b8a0-b375740f7959" released by "delete_volume" :: held 1.080s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4cac56cd-d6c3-4c6f-a928-698a26dfa7e0 tempest-ServerActionsTestOtherA-1043843369 None] Acquiring lock "cinder-aadee00d-d9cf-4485-af34-b998995255a4-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG cinder.quota [req-6738e3cd-0abc-4b68-9c83-234985d0d1c6 req-15043a87-9d6b-4797-a60c-61421421efc5 tempest-ServerActionsTestOtherA-1043843369 None] Created reservations ['ebc04516-0e63-4d79-9843-0f8eb7376059', '8bfd5ac9-0808-4da0-ad17-b3e889d5776a', '6b5ec919-b05a-45af-9081-4a761218b7a8', 'c2f86a5a-415c-4c53-a235-fa611d059313'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Flow 'volume_create_manager' (931b0f13-405f-4582-bbec-5658652b9cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43867762-123a-49f7-80b3-6c2442f95a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4cac56cd-d6c3-4c6f-a928-698a26dfa7e0 tempest-ServerActionsTestOtherA-1043843369 None] Lock "cinder-aadee00d-d9cf-4485-af34-b998995255a4-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43867762-123a-49f7-80b3-6c2442f95a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1257760244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91f94861-7c00-40ce-b9fa-a8e0cac6bd59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e40fbaeb2c946c183603d8ee4ed5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:04:18Z,use_quota=True,user_id='a8b3b23a61084eb1bc7c4e42baf24b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c5f0f0-946f-473b-bead-a0d1ad3a2b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c5f0f0-946f-473b-bead-a0d1ad3a2b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b0d325d-b32d-491a-b65f-26620cad9522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b0d325d-b32d-491a-b65f-26620cad9522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91f94861-7c00-40ce-b9fa-a8e0cac6bd59', 'volume_name': 'volume-91f94861-7c00-40ce-b9fa-a8e0cac6bd59', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3c671c-3bf4-4f78-86e3-d90971cd53a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b3c671c-3bf4-4f78-86e3-d90971cd53a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80e29d46-398f-478d-9ddf-18d2aad82096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:18 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Volume 91f94861-7c00-40ce-b9fa-a8e0cac6bd59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91f94861-7c00-40ce-b9fa-a8e0cac6bd59', 'volume_size': 1}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1257760244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91f94861-7c00-40ce-b9fa-a8e0cac6bd59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e40fbaeb2c946c183603d8ee4ed5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:04:18Z,use_quota=True,user_id='a8b3b23a61084eb1bc7c4e42baf24b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Creating volume 91f94861-7c00-40ce-b9fa-a8e0cac6bd59 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:04:18 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-91f94861-7c00-40ce-b9fa-a8e0cac6bd59 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:18 devstack sudo[93571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-91f94861-7c00-40ce-b9fa-a8e0cac6bd59 1073741824
Sep 07 18:04:18 devstack sudo[93571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-6738e3cd-0abc-4b68-9c83-234985d0d1c6 req-15043a87-9d6b-4797-a60c-61421421efc5 tempest-ServerActionsTestOtherA-1043843369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-6738e3cd-0abc-4b68-9c83-234985d0d1c6 req-15043a87-9d6b-4797-a60c-61421421efc5 tempest-ServerActionsTestOtherA-1043843369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-6738e3cd-0abc-4b68-9c83-234985d0d1c6 req-15043a87-9d6b-4797-a60c-61421421efc5 tempest-ServerActionsTestOtherA-1043843369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-6738e3cd-0abc-4b68-9c83-234985d0d1c6 req-15043a87-9d6b-4797-a60c-61421421efc5 tempest-ServerActionsTestOtherA-1043843369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-6738e3cd-0abc-4b68-9c83-234985d0d1c6 req-15043a87-9d6b-4797-a60c-61421421efc5 tempest-ServerActionsTestOtherA-1043843369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-6738e3cd-0abc-4b68-9c83-234985d0d1c6 req-15043a87-9d6b-4797-a60c-61421421efc5 tempest-ServerActionsTestOtherA-1043843369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4cac56cd-d6c3-4c6f-a928-698a26dfa7e0 tempest-ServerActionsTestOtherA-1043843369 None] Acquiring lock "cinder-quobyte-aadee00d-d9cf-4485-af34-b998995255a4" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4cac56cd-d6c3-4c6f-a928-698a26dfa7e0 tempest-ServerActionsTestOtherA-1043843369 None] Lock "cinder-quobyte-aadee00d-d9cf-4485-af34-b998995255a4" acquired by "delete_volume" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:18 devstack sudo[93573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:04:18 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fa6947-355d-4dbf-a288-a48b85e527a3]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cac56cd-d6c3-4c6f-a928-698a26dfa7e0 tempest-ServerActionsTestOtherA-1043843369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aadee00d-d9cf-4485-af34-b998995255a4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:18 devstack sudo[93576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aadee00d-d9cf-4485-af34-b998995255a4
Sep 07 18:04:18 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:18 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-6738e3cd-0abc-4b68-9c83-234985d0d1c6 req-15043a87-9d6b-4797-a60c-61421421efc5 tempest-ServerActionsTestOtherA-1043843369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.358s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG cinder.manager [req-6738e3cd-0abc-4b68-9c83-234985d0d1c6 req-15043a87-9d6b-4797-a60c-61421421efc5 tempest-ServerActionsTestOtherA-1043843369 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:04:18 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-6738e3cd-0abc-4b68-9c83-234985d0d1c6 req-15043a87-9d6b-4797-a60c-61421421efc5 tempest-ServerActionsTestOtherA-1043843369 None] Deleted volume successfully.
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-6738e3cd-0abc-4b68-9c83-234985d0d1c6 req-15043a87-9d6b-4797-a60c-61421421efc5 tempest-ServerActionsTestOtherA-1043843369 None] Lock "cinder-9ec5c863-33cc-44f1-b8a0-b375740f7959-delete_volume" released by "delete_volume" :: held 2.104s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:18 devstack sudo[93571]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-91f94861-7c00-40ce-b9fa-a8e0cac6bd59 1073741824" returned: 0 in 0.696s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-91f94861-7c00-40ce-b9fa-a8e0cac6bd59 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:19 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cac56cd-d6c3-4c6f-a928-698a26dfa7e0 tempest-ServerActionsTestOtherA-1043843369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aadee00d-d9cf-4485-af34-b998995255a4" returned: 0 in 0.549s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cac56cd-d6c3-4c6f-a928-698a26dfa7e0 tempest-ServerActionsTestOtherA-1043843369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aadee00d-d9cf-4485-af34-b998995255a4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:19 devstack sudo[93587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-91f94861-7c00-40ce-b9fa-a8e0cac6bd59
Sep 07 18:04:19 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:19 devstack sudo[93588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aadee00d-d9cf-4485-af34-b998995255a4
Sep 07 18:04:19 devstack sudo[93588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:19 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-91f94861-7c00-40ce-b9fa-a8e0cac6bd59" returned: 0 in 0.299s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:04:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80e29d46-398f-478d-9ddf-18d2aad82096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91f94861-7c00-40ce-b9fa-a8e0cac6bd59', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f6a108-02be-4bd0-9cae-159e10a32012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:19 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Volume volume-91f94861-7c00-40ce-b9fa-a8e0cac6bd59 (91f94861-7c00-40ce-b9fa-a8e0cac6bd59): created successfully
Sep 07 18:04:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f6a108-02be-4bd0-9cae-159e10a32012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Flow 'volume_create_manager' (931b0f13-405f-4582-bbec-5658652b9cc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:04:19 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3b42e3f6-c237-4330-9c87-813bef66aa14 tempest-VolumesActionsTest-2130616910 None] Created volume successfully.
Sep 07 18:04:19 devstack sudo[93588]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cac56cd-d6c3-4c6f-a928-698a26dfa7e0 tempest-ServerActionsTestOtherA-1043843369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aadee00d-d9cf-4485-af34-b998995255a4" returned: 0 in 0.418s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4cac56cd-d6c3-4c6f-a928-698a26dfa7e0 tempest-ServerActionsTestOtherA-1043843369 None] Lock "cinder-quobyte-aadee00d-d9cf-4485-af34-b998995255a4" released by "delete_volume" :: held 1.045s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:19 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-4cac56cd-d6c3-4c6f-a928-698a26dfa7e0 tempest-ServerActionsTestOtherA-1043843369 None] Created reservations ['5a808c8d-2c88-471d-84c8-b06ff77efd84', '1bdb003b-8557-44ee-8a67-69daf7e79c77', 'f8db6a1a-cd3b-4d49-9dba-3f341e150142', 'd068d897-b8ad-4b70-896b-7576eb1bd6cf'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:04:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4cac56cd-d6c3-4c6f-a928-698a26dfa7e0 tempest-ServerActionsTestOtherA-1043843369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4cac56cd-d6c3-4c6f-a928-698a26dfa7e0 tempest-ServerActionsTestOtherA-1043843369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4cac56cd-d6c3-4c6f-a928-698a26dfa7e0 tempest-ServerActionsTestOtherA-1043843369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:04:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4cac56cd-d6c3-4c6f-a928-698a26dfa7e0 tempest-ServerActionsTestOtherA-1043843369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:04:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4cac56cd-d6c3-4c6f-a928-698a26dfa7e0 tempest-ServerActionsTestOtherA-1043843369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cac56cd-d6c3-4c6f-a928-698a26dfa7e0 tempest-ServerActionsTestOtherA-1043843369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:19 devstack sudo[93594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:04:19 devstack sudo[93594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:19 devstack sudo[93594]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4cac56cd-d6c3-4c6f-a928-698a26dfa7e0 tempest-ServerActionsTestOtherA-1043843369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.266s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-4cac56cd-d6c3-4c6f-a928-698a26dfa7e0 tempest-ServerActionsTestOtherA-1043843369 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:04:19 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4cac56cd-d6c3-4c6f-a928-698a26dfa7e0 tempest-ServerActionsTestOtherA-1043843369 None] Deleted volume successfully.
Sep 07 18:04:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4cac56cd-d6c3-4c6f-a928-698a26dfa7e0 tempest-ServerActionsTestOtherA-1043843369 None] Lock "cinder-aadee00d-d9cf-4485-af34-b998995255a4-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f334d973-d651-4b99-b25f-1ea78c9b622a tempest-VolumesActionsTest-1560007546 None] Acquiring lock "cinder-91f94861-7c00-40ce-b9fa-a8e0cac6bd59-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f334d973-d651-4b99-b25f-1ea78c9b622a tempest-VolumesActionsTest-1560007546 None] Lock "cinder-91f94861-7c00-40ce-b9fa-a8e0cac6bd59-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f334d973-d651-4b99-b25f-1ea78c9b622a tempest-VolumesActionsTest-1560007546 None] Acquiring lock "cinder-quobyte-91f94861-7c00-40ce-b9fa-a8e0cac6bd59" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f334d973-d651-4b99-b25f-1ea78c9b622a tempest-VolumesActionsTest-1560007546 None] Lock "cinder-quobyte-91f94861-7c00-40ce-b9fa-a8e0cac6bd59" acquired by "delete_volume" :: waited 0.035s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:20 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9e622b-766a-46a0-a0c9-9a3b813d58b1]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:04:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f334d973-d651-4b99-b25f-1ea78c9b622a tempest-VolumesActionsTest-1560007546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-91f94861-7c00-40ce-b9fa-a8e0cac6bd59 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:20 devstack sudo[93597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-91f94861-7c00-40ce-b9fa-a8e0cac6bd59
Sep 07 18:04:20 devstack sudo[93597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:20 devstack sudo[93597]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f334d973-d651-4b99-b25f-1ea78c9b622a tempest-VolumesActionsTest-1560007546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-91f94861-7c00-40ce-b9fa-a8e0cac6bd59" returned: 0 in 0.466s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f334d973-d651-4b99-b25f-1ea78c9b622a tempest-VolumesActionsTest-1560007546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-91f94861-7c00-40ce-b9fa-a8e0cac6bd59 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:20 devstack sudo[93605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-91f94861-7c00-40ce-b9fa-a8e0cac6bd59
Sep 07 18:04:20 devstack sudo[93605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:21 devstack sudo[93605]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f334d973-d651-4b99-b25f-1ea78c9b622a tempest-VolumesActionsTest-1560007546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-91f94861-7c00-40ce-b9fa-a8e0cac6bd59" returned: 0 in 0.403s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f334d973-d651-4b99-b25f-1ea78c9b622a tempest-VolumesActionsTest-1560007546 None] Lock "cinder-quobyte-91f94861-7c00-40ce-b9fa-a8e0cac6bd59" released by "delete_volume" :: held 0.941s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:21 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-f334d973-d651-4b99-b25f-1ea78c9b622a tempest-VolumesActionsTest-1560007546 None] Created reservations ['c0cce44f-7cd9-4232-8173-c968704853cf', '7d8d1cab-1f5f-4781-b79b-480273f8f085', '502584fb-5e7d-4df1-8595-e6560e394f04', 'ac2b4ece-2e51-4ee5-9e95-ce96709012c6'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:04:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f334d973-d651-4b99-b25f-1ea78c9b622a tempest-VolumesActionsTest-1560007546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f334d973-d651-4b99-b25f-1ea78c9b622a tempest-VolumesActionsTest-1560007546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f334d973-d651-4b99-b25f-1ea78c9b622a tempest-VolumesActionsTest-1560007546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:04:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f334d973-d651-4b99-b25f-1ea78c9b622a tempest-VolumesActionsTest-1560007546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:04:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f334d973-d651-4b99-b25f-1ea78c9b622a tempest-VolumesActionsTest-1560007546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f334d973-d651-4b99-b25f-1ea78c9b622a tempest-VolumesActionsTest-1560007546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:21 devstack sudo[93628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:04:21 devstack sudo[93628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:21 devstack sudo[93628]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f334d973-d651-4b99-b25f-1ea78c9b622a tempest-VolumesActionsTest-1560007546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.279s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:21 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f334d973-d651-4b99-b25f-1ea78c9b622a tempest-VolumesActionsTest-1560007546 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:04:21 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f334d973-d651-4b99-b25f-1ea78c9b622a tempest-VolumesActionsTest-1560007546 None] Deleted volume successfully.
Sep 07 18:04:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f334d973-d651-4b99-b25f-1ea78c9b622a tempest-VolumesActionsTest-1560007546 None] Lock "cinder-91f94861-7c00-40ce-b9fa-a8e0cac6bd59-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:23 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:04:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Flow 'volume_create_manager' (37b48882-3c42-4fee-a521-074e19b34692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:04:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (833b419e-0765-4f4f-9d26-a80431b93ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (833b419e-0765-4f4f-9d26-a80431b93ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1915253577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=353ae691-52c2-4a0b-b66f-8370c871ad43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e40fbaeb2c946c183603d8ee4ed5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:04:23Z,use_quota=True,user_id='a8b3b23a61084eb1bc7c4e42baf24b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b8aaf9-71c2-4dc7-aa25-af45633c93b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47b8aaf9-71c2-4dc7-aa25-af45633c93b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8933a7e-4240-40b2-a1a7-c10f0e38821d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8933a7e-4240-40b2-a1a7-c10f0e38821d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '353ae691-52c2-4a0b-b66f-8370c871ad43', 'volume_name': 'volume-353ae691-52c2-4a0b-b66f-8370c871ad43', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc4241f-37cc-4fd7-8802-9d1e3b57fd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc4241f-37cc-4fd7-8802-9d1e3b57fd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97dcdf6-9ea6-42f3-a77c-72f9d90d3e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:23 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Volume 353ae691-52c2-4a0b-b66f-8370c871ad43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-353ae691-52c2-4a0b-b66f-8370c871ad43', 'volume_size': 1}
Sep 07 18:04:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1915253577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=353ae691-52c2-4a0b-b66f-8370c871ad43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e40fbaeb2c946c183603d8ee4ed5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:04:23Z,use_quota=True,user_id='a8b3b23a61084eb1bc7c4e42baf24b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:04:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Creating volume 353ae691-52c2-4a0b-b66f-8370c871ad43 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:04:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:04:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:04:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:04:23 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:04:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-353ae691-52c2-4a0b-b66f-8370c871ad43 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:23 devstack sudo[93639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-353ae691-52c2-4a0b-b66f-8370c871ad43 1073741824
Sep 07 18:04:23 devstack sudo[93639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:23 devstack sudo[93639]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-353ae691-52c2-4a0b-b66f-8370c871ad43 1073741824" returned: 0 in 0.548s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-353ae691-52c2-4a0b-b66f-8370c871ad43 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:23 devstack sudo[93646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-353ae691-52c2-4a0b-b66f-8370c871ad43
Sep 07 18:04:23 devstack sudo[93646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:24 devstack sudo[93646]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-353ae691-52c2-4a0b-b66f-8370c871ad43" returned: 0 in 0.266s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:04:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97dcdf6-9ea6-42f3-a77c-72f9d90d3e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-353ae691-52c2-4a0b-b66f-8370c871ad43', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5228e85c-1475-47d1-8e57-ae156f6e8e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:24 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Volume volume-353ae691-52c2-4a0b-b66f-8370c871ad43 (353ae691-52c2-4a0b-b66f-8370c871ad43): created successfully
Sep 07 18:04:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5228e85c-1475-47d1-8e57-ae156f6e8e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Flow 'volume_create_manager' (37b48882-3c42-4fee-a521-074e19b34692) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:04:24 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9297a829-0ca8-48c2-9667-bd22aba23233 tempest-VolumesActionsTest-2130616910 None] Created volume successfully.
Sep 07 18:04:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e6c5d03a-be5a-45e2-b80c-81a91015838e tempest-VolumesActionsTest-1560007546 None] Acquiring lock "cinder-353ae691-52c2-4a0b-b66f-8370c871ad43-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e6c5d03a-be5a-45e2-b80c-81a91015838e tempest-VolumesActionsTest-1560007546 None] Lock "cinder-353ae691-52c2-4a0b-b66f-8370c871ad43-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e6c5d03a-be5a-45e2-b80c-81a91015838e tempest-VolumesActionsTest-1560007546 None] Acquiring lock "cinder-quobyte-353ae691-52c2-4a0b-b66f-8370c871ad43" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e6c5d03a-be5a-45e2-b80c-81a91015838e tempest-VolumesActionsTest-1560007546 None] Lock "cinder-quobyte-353ae691-52c2-4a0b-b66f-8370c871ad43" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:25 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cf2a3b-03af-4fca-9e3c-1daae0ffc2d9]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:04:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e6c5d03a-be5a-45e2-b80c-81a91015838e tempest-VolumesActionsTest-1560007546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-353ae691-52c2-4a0b-b66f-8370c871ad43 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:25 devstack sudo[93650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-353ae691-52c2-4a0b-b66f-8370c871ad43
Sep 07 18:04:25 devstack sudo[93650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:26 devstack sudo[93650]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e6c5d03a-be5a-45e2-b80c-81a91015838e tempest-VolumesActionsTest-1560007546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-353ae691-52c2-4a0b-b66f-8370c871ad43" returned: 0 in 0.521s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e6c5d03a-be5a-45e2-b80c-81a91015838e tempest-VolumesActionsTest-1560007546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-353ae691-52c2-4a0b-b66f-8370c871ad43 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:26 devstack sudo[93656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-353ae691-52c2-4a0b-b66f-8370c871ad43
Sep 07 18:04:26 devstack sudo[93656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:26 devstack sudo[93656]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e6c5d03a-be5a-45e2-b80c-81a91015838e tempest-VolumesActionsTest-1560007546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-353ae691-52c2-4a0b-b66f-8370c871ad43" returned: 0 in 0.297s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e6c5d03a-be5a-45e2-b80c-81a91015838e tempest-VolumesActionsTest-1560007546 None] Lock "cinder-quobyte-353ae691-52c2-4a0b-b66f-8370c871ad43" released by "delete_volume" :: held 0.863s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:26 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-e6c5d03a-be5a-45e2-b80c-81a91015838e tempest-VolumesActionsTest-1560007546 None] Created reservations ['aec653b1-683d-4947-9b77-97f4cfd3e5c1', '2afce7dd-a916-4f84-af64-82cc8a4c565a', '435fec9f-1e9f-410a-807e-e7a18988feea', 'c7cb34ac-44dc-44e0-ae36-43a91ede6f32'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:04:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e6c5d03a-be5a-45e2-b80c-81a91015838e tempest-VolumesActionsTest-1560007546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e6c5d03a-be5a-45e2-b80c-81a91015838e tempest-VolumesActionsTest-1560007546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e6c5d03a-be5a-45e2-b80c-81a91015838e tempest-VolumesActionsTest-1560007546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:04:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e6c5d03a-be5a-45e2-b80c-81a91015838e tempest-VolumesActionsTest-1560007546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:04:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e6c5d03a-be5a-45e2-b80c-81a91015838e tempest-VolumesActionsTest-1560007546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e6c5d03a-be5a-45e2-b80c-81a91015838e tempest-VolumesActionsTest-1560007546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:26 devstack sudo[93659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:04:26 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:26 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e6c5d03a-be5a-45e2-b80c-81a91015838e tempest-VolumesActionsTest-1560007546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.292s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:26 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-e6c5d03a-be5a-45e2-b80c-81a91015838e tempest-VolumesActionsTest-1560007546 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:04:26 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e6c5d03a-be5a-45e2-b80c-81a91015838e tempest-VolumesActionsTest-1560007546 None] Deleted volume successfully.
Sep 07 18:04:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e6c5d03a-be5a-45e2-b80c-81a91015838e tempest-VolumesActionsTest-1560007546 None] Lock "cinder-353ae691-52c2-4a0b-b66f-8370c871ad43-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:27 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:04:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Flow 'volume_create_manager' (4635a9cd-95a4-4253-b1b7-60c0aa82ef7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:04:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8438499b-92b9-4a66-be98-0b8c4d8d69a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8438499b-92b9-4a66-be98-0b8c4d8d69a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1544157524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0d6699b-874b-4eaf-9074-e618eebf1fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e40fbaeb2c946c183603d8ee4ed5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:04:27Z,use_quota=True,user_id='a8b3b23a61084eb1bc7c4e42baf24b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f040e9-6bec-43d4-b892-78153b73ba2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4f040e9-6bec-43d4-b892-78153b73ba2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b8f7b3-1a2e-41f4-b9f2-1ac6e82257e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b8f7b3-1a2e-41f4-b9f2-1ac6e82257e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0d6699b-874b-4eaf-9074-e618eebf1fa8', 'volume_name': 'volume-d0d6699b-874b-4eaf-9074-e618eebf1fa8', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f982b1af-552c-4bd8-b755-c1f14ba760d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f982b1af-552c-4bd8-b755-c1f14ba760d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19767be-d488-4a7f-bd45-1e6f038bc72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:27 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Volume d0d6699b-874b-4eaf-9074-e618eebf1fa8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0d6699b-874b-4eaf-9074-e618eebf1fa8', 'volume_size': 1}
Sep 07 18:04:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1544157524',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0d6699b-874b-4eaf-9074-e618eebf1fa8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e40fbaeb2c946c183603d8ee4ed5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:04:27Z,use_quota=True,user_id='a8b3b23a61084eb1bc7c4e42baf24b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:04:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Creating volume d0d6699b-874b-4eaf-9074-e618eebf1fa8 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:04:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:04:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:04:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:04:27 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:04:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0d6699b-874b-4eaf-9074-e618eebf1fa8 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:27 devstack sudo[93662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0d6699b-874b-4eaf-9074-e618eebf1fa8 1073741824
Sep 07 18:04:27 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:27 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0d6699b-874b-4eaf-9074-e618eebf1fa8 1073741824" returned: 0 in 0.627s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0d6699b-874b-4eaf-9074-e618eebf1fa8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:28 devstack sudo[93668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0d6699b-874b-4eaf-9074-e618eebf1fa8
Sep 07 18:04:28 devstack sudo[93668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:28 devstack sudo[93668]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0d6699b-874b-4eaf-9074-e618eebf1fa8" returned: 0 in 0.504s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:04:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19767be-d488-4a7f-bd45-1e6f038bc72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0d6699b-874b-4eaf-9074-e618eebf1fa8', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2821954-6289-4a0c-b608-2e9832b94e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:28 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Volume volume-d0d6699b-874b-4eaf-9074-e618eebf1fa8 (d0d6699b-874b-4eaf-9074-e618eebf1fa8): created successfully
Sep 07 18:04:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2821954-6289-4a0c-b608-2e9832b94e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Flow 'volume_create_manager' (4635a9cd-95a4-4253-b1b7-60c0aa82ef7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:04:28 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0b936282-d66f-4b99-bc57-3355bdb2a444 tempest-VolumesActionsTest-2130616910 None] Created volume successfully.
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-30ea85a9-e2d2-461a-b637-0cba55d6793c tempest-VolumesActionsTest-1560007546 None] Acquiring lock "cinder-d0d6699b-874b-4eaf-9074-e618eebf1fa8-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Flow 'volume_create_manager' (c88f0753-631f-4501-a21a-fb46ea48b959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed13cd2-b29f-4e4f-ac90-3a6420a5ebcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-30ea85a9-e2d2-461a-b637-0cba55d6793c tempest-VolumesActionsTest-1560007546 None] Lock "cinder-d0d6699b-874b-4eaf-9074-e618eebf1fa8-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed13cd2-b29f-4e4f-ac90-3a6420a5ebcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-525081101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f1bc092-ac4d-41b7-a219-65fb23d3b19d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67809777a7334848a31071dcaedcfc15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:04:29Z,use_quota=True,user_id='0325fda463b64bd8bc0df54119f3fa44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (211df5b0-8719-4483-82fc-74151e373b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (211df5b0-8719-4483-82fc-74151e373b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07ee6603-6ed2-4822-a97c-e548740448cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07ee6603-6ed2-4822-a97c-e548740448cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f1bc092-ac4d-41b7-a219-65fb23d3b19d', 'volume_name': 'volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (026fc2f5-ce5a-4498-8931-cd7d3916c450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (026fc2f5-ce5a-4498-8931-cd7d3916c450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b77218c-0951-4ee9-8228-5f176e9fbb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:29 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Volume 3f1bc092-ac4d-41b7-a219-65fb23d3b19d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d', 'volume_size': 1}
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-525081101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f1bc092-ac4d-41b7-a219-65fb23d3b19d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67809777a7334848a31071dcaedcfc15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:04:29Z,use_quota=True,user_id='0325fda463b64bd8bc0df54119f3fa44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Creating volume 3f1bc092-ac4d-41b7-a219-65fb23d3b19d {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:04:29 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:29 devstack sudo[93672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d 1073741824
Sep 07 18:04:29 devstack sudo[93672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-30ea85a9-e2d2-461a-b637-0cba55d6793c tempest-VolumesActionsTest-1560007546 None] Acquiring lock "cinder-quobyte-d0d6699b-874b-4eaf-9074-e618eebf1fa8" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-30ea85a9-e2d2-461a-b637-0cba55d6793c tempest-VolumesActionsTest-1560007546 None] Lock "cinder-quobyte-d0d6699b-874b-4eaf-9074-e618eebf1fa8" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7643ca68-ca31-4b43-abf9-64a8bab69b47]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:04:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-30ea85a9-e2d2-461a-b637-0cba55d6793c tempest-VolumesActionsTest-1560007546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0d6699b-874b-4eaf-9074-e618eebf1fa8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:29 devstack sudo[93674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0d6699b-874b-4eaf-9074-e618eebf1fa8
Sep 07 18:04:29 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:30 devstack sudo[93672]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d 1073741824" returned: 0 in 0.627s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:30 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-30ea85a9-e2d2-461a-b637-0cba55d6793c tempest-VolumesActionsTest-1560007546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0d6699b-874b-4eaf-9074-e618eebf1fa8" returned: 0 in 0.514s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-30ea85a9-e2d2-461a-b637-0cba55d6793c tempest-VolumesActionsTest-1560007546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0d6699b-874b-4eaf-9074-e618eebf1fa8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:30 devstack sudo[93685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0d6699b-874b-4eaf-9074-e618eebf1fa8
Sep 07 18:04:30 devstack sudo[93685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:30 devstack sudo[93687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d
Sep 07 18:04:30 devstack sudo[93687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:30 devstack sudo[93685]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-30ea85a9-e2d2-461a-b637-0cba55d6793c tempest-VolumesActionsTest-1560007546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0d6699b-874b-4eaf-9074-e618eebf1fa8" returned: 0 in 0.509s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-30ea85a9-e2d2-461a-b637-0cba55d6793c tempest-VolumesActionsTest-1560007546 None] Lock "cinder-quobyte-d0d6699b-874b-4eaf-9074-e618eebf1fa8" released by "delete_volume" :: held 1.112s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:30 devstack sudo[93687]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d" returned: 0 in 0.520s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:04:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b77218c-0951-4ee9-8228-5f176e9fbb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e42387a2-f6a7-40ab-8df9-f9df6f67cbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:30 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Volume volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d (3f1bc092-ac4d-41b7-a219-65fb23d3b19d): created successfully
Sep 07 18:04:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e42387a2-f6a7-40ab-8df9-f9df6f67cbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Flow 'volume_create_manager' (c88f0753-631f-4501-a21a-fb46ea48b959) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:04:30 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e63ee54a-835a-4498-bac4-0f7c16e4dc71 tempest-VolumesSnapshotTestJSON-1640546916 None] Created volume successfully.
Sep 07 18:04:30 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-30ea85a9-e2d2-461a-b637-0cba55d6793c tempest-VolumesActionsTest-1560007546 None] Created reservations ['c1a3270e-aa95-4816-9282-352fbd9597aa', '4e005783-625a-410c-b419-08647e25f9e8', '2b9b4cde-9c3f-413c-8243-b6cdc6249e13', 'cb792f10-13d0-4d24-bda7-64e70793d620'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:04:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-30ea85a9-e2d2-461a-b637-0cba55d6793c tempest-VolumesActionsTest-1560007546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-30ea85a9-e2d2-461a-b637-0cba55d6793c tempest-VolumesActionsTest-1560007546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-30ea85a9-e2d2-461a-b637-0cba55d6793c tempest-VolumesActionsTest-1560007546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:04:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-30ea85a9-e2d2-461a-b637-0cba55d6793c tempest-VolumesActionsTest-1560007546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:04:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-30ea85a9-e2d2-461a-b637-0cba55d6793c tempest-VolumesActionsTest-1560007546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-30ea85a9-e2d2-461a-b637-0cba55d6793c tempest-VolumesActionsTest-1560007546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:31 devstack sudo[93697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:04:31 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:31 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-30ea85a9-e2d2-461a-b637-0cba55d6793c tempest-VolumesActionsTest-1560007546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.483s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:31 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-30ea85a9-e2d2-461a-b637-0cba55d6793c tempest-VolumesActionsTest-1560007546 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:04:31 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-30ea85a9-e2d2-461a-b637-0cba55d6793c tempest-VolumesActionsTest-1560007546 None] Deleted volume successfully.
Sep 07 18:04:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-30ea85a9-e2d2-461a-b637-0cba55d6793c tempest-VolumesActionsTest-1560007546 None] Lock "cinder-d0d6699b-874b-4eaf-9074-e618eebf1fa8-delete_volume" released by "delete_volume" :: held 2.058s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-54907d92-7d73-4e6f-883f-4292b3fa260c tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-54907d92-7d73-4e6f-883f-4292b3fa260c tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-54907d92-7d73-4e6f-883f-4292b3fa260c tempest-VolumesSnapshotTestJSON-1640546916 None] Creating offline snapshot a936fbf4-1b97-4884-9c6e-f7e144391e13 of volume 3f1bc092-ac4d-41b7-a219-65fb23d3b19d {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:04:32 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f0be14-59bc-402c-b28c-a27cfc150aac]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:04:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54907d92-7d73-4e6f-883f-4292b3fa260c tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:32 devstack sudo[93719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d
Sep 07 18:04:32 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:32 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:04:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Flow 'volume_create_manager' (f8080eb8-2baa-4e53-b49e-fac6055bc548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:04:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (844516dc-8b1c-4606-a624-637e1faed6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (844516dc-8b1c-4606-a624-637e1faed6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1691059390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3a2426-415b-4530-800b-74c4ac1930a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e40fbaeb2c946c183603d8ee4ed5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:04:32Z,use_quota=True,user_id='a8b3b23a61084eb1bc7c4e42baf24b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c88e2128-2ab5-4040-8291-817eecb5ca9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c88e2128-2ab5-4040-8291-817eecb5ca9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc939d6-dd25-4aff-a3c6-b4e00b22aa20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbc939d6-dd25-4aff-a3c6-b4e00b22aa20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c3a2426-415b-4530-800b-74c4ac1930a2', 'volume_name': 'volume-2c3a2426-415b-4530-800b-74c4ac1930a2', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a31992f-3c49-4b9a-a106-13b24b06e6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a31992f-3c49-4b9a-a106-13b24b06e6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc3d464-3c3c-4497-86a3-cc0f6338e5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:32 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Volume 2c3a2426-415b-4530-800b-74c4ac1930a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c3a2426-415b-4530-800b-74c4ac1930a2', 'volume_size': 1}
Sep 07 18:04:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:32 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54907d92-7d73-4e6f-883f-4292b3fa260c tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d" returned: 0 in 0.593s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54907d92-7d73-4e6f-883f-4292b3fa260c tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d.a936fbf4-1b97-4884-9c6e-f7e144391e13 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:32 devstack sudo[93725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d.a936fbf4-1b97-4884-9c6e-f7e144391e13 1G
Sep 07 18:04:32 devstack sudo[93725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:33 devstack sudo[93725]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54907d92-7d73-4e6f-883f-4292b3fa260c tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d.a936fbf4-1b97-4884-9c6e-f7e144391e13 1G" returned: 0 in 0.474s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54907d92-7d73-4e6f-883f-4292b3fa260c tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d.a936fbf4-1b97-4884-9c6e-f7e144391e13 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:33 devstack sudo[93732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d.a936fbf4-1b97-4884-9c6e-f7e144391e13
Sep 07 18:04:33 devstack sudo[93732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:33 devstack sudo[93732]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54907d92-7d73-4e6f-883f-4292b3fa260c tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d.a936fbf4-1b97-4884-9c6e-f7e144391e13" returned: 0 in 0.406s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:33 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-54907d92-7d73-4e6f-883f-4292b3fa260c tempest-VolumesSnapshotTestJSON-1640546916 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d.a936fbf4-1b97-4884-9c6e-f7e144391e13 is being set with open permissions: ugo+rw
Sep 07 18:04:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54907d92-7d73-4e6f-883f-4292b3fa260c tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d.a936fbf4-1b97-4884-9c6e-f7e144391e13 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:33 devstack sudo[93740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d.a936fbf4-1b97-4884-9c6e-f7e144391e13
Sep 07 18:04:33 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:33 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54907d92-7d73-4e6f-883f-4292b3fa260c tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d.a936fbf4-1b97-4884-9c6e-f7e144391e13" returned: 0 in 0.305s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54907d92-7d73-4e6f-883f-4292b3fa260c tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:34 devstack sudo[93743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d.info
Sep 07 18:04:34 devstack sudo[93743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:34 devstack sudo[93743]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54907d92-7d73-4e6f-883f-4292b3fa260c tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d.info" returned: 0 in 0.293s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:34 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-54907d92-7d73-4e6f-883f-4292b3fa260c tempest-VolumesSnapshotTestJSON-1640546916 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d.info is being set with open permissions: ugo+rw
Sep 07 18:04:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54907d92-7d73-4e6f-883f-4292b3fa260c tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:34 devstack sudo[93746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d.info
Sep 07 18:04:34 devstack sudo[93746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:34 devstack sudo[93746]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54907d92-7d73-4e6f-883f-4292b3fa260c tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d.info" returned: 0 in 0.281s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-54907d92-7d73-4e6f-883f-4292b3fa260c tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.480s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.865s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1691059390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3a2426-415b-4530-800b-74c4ac1930a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e40fbaeb2c946c183603d8ee4ed5a14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:04:32Z,use_quota=True,user_id='a8b3b23a61084eb1bc7c4e42baf24b9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:04:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Creating volume 2c3a2426-415b-4530-800b-74c4ac1930a2 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:04:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:04:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:04:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:04:34 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:04:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2c3a2426-415b-4530-800b-74c4ac1930a2 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:34 devstack sudo[93749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2c3a2426-415b-4530-800b-74c4ac1930a2 1073741824
Sep 07 18:04:34 devstack sudo[93749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:34 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-54907d92-7d73-4e6f-883f-4292b3fa260c tempest-VolumesSnapshotTestJSON-1640546916 None] Create snapshot completed successfully
Sep 07 18:04:35 devstack sudo[93749]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2c3a2426-415b-4530-800b-74c4ac1930a2 1073741824" returned: 0 in 0.503s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2c3a2426-415b-4530-800b-74c4ac1930a2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:35 devstack sudo[93755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2c3a2426-415b-4530-800b-74c4ac1930a2
Sep 07 18:04:35 devstack sudo[93755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7302f26e-24ab-4659-a846-36d3e8f5060a tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "cinder-a936fbf4-1b97-4884-9c6e-f7e144391e13-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7302f26e-24ab-4659-a846-36d3e8f5060a tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-a936fbf4-1b97-4884-9c6e-f7e144391e13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7302f26e-24ab-4659-a846-36d3e8f5060a tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "cinder-quobyte-3f1bc092-ac4d-41b7-a219-65fb23d3b19d" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7302f26e-24ab-4659-a846-36d3e8f5060a tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-3f1bc092-ac4d-41b7-a219-65fb23d3b19d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7302f26e-24ab-4659-a846-36d3e8f5060a tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "cinder-quobyte-a936fbf4-1b97-4884-9c6e-f7e144391e13" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7302f26e-24ab-4659-a846-36d3e8f5060a tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-a936fbf4-1b97-4884-9c6e-f7e144391e13" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-7302f26e-24ab-4659-a846-36d3e8f5060a tempest-VolumesSnapshotTestJSON-1640546916 None] Deleting offline snapshot a936fbf4-1b97-4884-9c6e-f7e144391e13 of volume 3f1bc092-ac4d-41b7-a219-65fb23d3b19d {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:04:35 devstack sudo[93755]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-7302f26e-24ab-4659-a846-36d3e8f5060a tempest-VolumesSnapshotTestJSON-1640546916 None] snapshot_file for this snap is: volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d.a936fbf4-1b97-4884-9c6e-f7e144391e13 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:04:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2c3a2426-415b-4530-800b-74c4ac1930a2" returned: 0 in 0.417s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:04:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:35 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbff743-2ccf-4892-9629-ad8a0a9c5f08]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:04:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7302f26e-24ab-4659-a846-36d3e8f5060a tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d.a936fbf4-1b97-4884-9c6e-f7e144391e13 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc3d464-3c3c-4497-86a3-cc0f6338e5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c3a2426-415b-4530-800b-74c4ac1930a2', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e6dfe2-aab1-473d-93d1-0890b6e775ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:35 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Volume volume-2c3a2426-415b-4530-800b-74c4ac1930a2 (2c3a2426-415b-4530-800b-74c4ac1930a2): created successfully
Sep 07 18:04:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e6dfe2-aab1-473d-93d1-0890b6e775ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Flow 'volume_create_manager' (f8080eb8-2baa-4e53-b49e-fac6055bc548) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:04:35 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-21e05cd1-d3ff-4701-b8fe-9ef4d85edd8f tempest-VolumesActionsTest-2130616910 None] Created volume successfully.
Sep 07 18:04:35 devstack sudo[93760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d.a936fbf4-1b97-4884-9c6e-f7e144391e13
Sep 07 18:04:35 devstack sudo[93760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:35 devstack sudo[93760]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7302f26e-24ab-4659-a846-36d3e8f5060a tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d.a936fbf4-1b97-4884-9c6e-f7e144391e13" returned: 0 in 0.418s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-7302f26e-24ab-4659-a846-36d3e8f5060a tempest-VolumesSnapshotTestJSON-1640546916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:04:36 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dac0c53-a231-4600-a9b2-ec24c9839ef8]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:04:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7302f26e-24ab-4659-a846-36d3e8f5060a tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:36 devstack sudo[93766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d
Sep 07 18:04:36 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:36 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7302f26e-24ab-4659-a846-36d3e8f5060a tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d" returned: 0 in 0.408s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7302f26e-24ab-4659-a846-36d3e8f5060a tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d.a936fbf4-1b97-4884-9c6e-f7e144391e13 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:36 devstack sudo[93771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d.a936fbf4-1b97-4884-9c6e-f7e144391e13
Sep 07 18:04:36 devstack sudo[93771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:36 devstack sudo[93771]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7302f26e-24ab-4659-a846-36d3e8f5060a tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d.a936fbf4-1b97-4884-9c6e-f7e144391e13" returned: 0 in 0.432s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7302f26e-24ab-4659-a846-36d3e8f5060a tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d.a936fbf4-1b97-4884-9c6e-f7e144391e13 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:36 devstack sudo[93777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d.a936fbf4-1b97-4884-9c6e-f7e144391e13
Sep 07 18:04:36 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:37 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7302f26e-24ab-4659-a846-36d3e8f5060a tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d.a936fbf4-1b97-4884-9c6e-f7e144391e13" returned: 0 in 0.340s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7302f26e-24ab-4659-a846-36d3e8f5060a tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-a936fbf4-1b97-4884-9c6e-f7e144391e13" released by "_delete_snapshot" :: held 1.752s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7302f26e-24ab-4659-a846-36d3e8f5060a tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-3f1bc092-ac4d-41b7-a219-65fb23d3b19d" released by "delete_snapshot" :: held 1.783s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:37 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-7302f26e-24ab-4659-a846-36d3e8f5060a tempest-VolumesSnapshotTestJSON-1640546916 None] Created reservations ['43ed759f-384c-4345-8dd8-b46f3cd05f8f', '03bb7672-005a-4055-8a13-7d4406430251', 'c75ea105-2d3b-4ef0-87cb-19991b8831ec', '58aaebcb-2b75-474c-b5cb-7a797bc7bb7e'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:04:37 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-7302f26e-24ab-4659-a846-36d3e8f5060a tempest-VolumesSnapshotTestJSON-1640546916 None] Delete snapshot completed successfully.
Sep 07 18:04:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7302f26e-24ab-4659-a846-36d3e8f5060a tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-a936fbf4-1b97-4884-9c6e-f7e144391e13-delete_snapshot" released by "delete_snapshot" :: held 2.042s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-034df3df-6407-4291-80b8-f0c5e36ab164 tempest-VolumesActionsTest-2130616910 None] Acquiring lock "cinder-2c3a2426-415b-4530-800b-74c4ac1930a2-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-034df3df-6407-4291-80b8-f0c5e36ab164 tempest-VolumesActionsTest-2130616910 None] Lock "cinder-2c3a2426-415b-4530-800b-74c4ac1930a2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-034df3df-6407-4291-80b8-f0c5e36ab164 tempest-VolumesActionsTest-2130616910 None] Acquiring lock "cinder-quobyte-2c3a2426-415b-4530-800b-74c4ac1930a2" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-034df3df-6407-4291-80b8-f0c5e36ab164 tempest-VolumesActionsTest-2130616910 None] Lock "cinder-quobyte-2c3a2426-415b-4530-800b-74c4ac1930a2" acquired by "delete_volume" :: waited 0.038s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:37 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[530a4914-d112-4942-a335-4afbb0c528d6]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:04:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-034df3df-6407-4291-80b8-f0c5e36ab164 tempest-VolumesActionsTest-2130616910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2c3a2426-415b-4530-800b-74c4ac1930a2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:37 devstack sudo[93780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2c3a2426-415b-4530-800b-74c4ac1930a2
Sep 07 18:04:37 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:38 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-034df3df-6407-4291-80b8-f0c5e36ab164 tempest-VolumesActionsTest-2130616910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2c3a2426-415b-4530-800b-74c4ac1930a2" returned: 0 in 0.439s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-034df3df-6407-4291-80b8-f0c5e36ab164 tempest-VolumesActionsTest-2130616910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2c3a2426-415b-4530-800b-74c4ac1930a2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:38 devstack sudo[93787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2c3a2426-415b-4530-800b-74c4ac1930a2
Sep 07 18:04:38 devstack sudo[93787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:38 devstack sudo[93787]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-034df3df-6407-4291-80b8-f0c5e36ab164 tempest-VolumesActionsTest-2130616910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2c3a2426-415b-4530-800b-74c4ac1930a2" returned: 0 in 0.302s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-034df3df-6407-4291-80b8-f0c5e36ab164 tempest-VolumesActionsTest-2130616910 None] Lock "cinder-quobyte-2c3a2426-415b-4530-800b-74c4ac1930a2" released by "delete_volume" :: held 0.813s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Flow 'volume_create_manager' (1aea08f4-0737-4a50-bfb4-26c7dc62f8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a1d2e67-a575-4c26-9393-15874ee76c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a1d2e67-a575-4c26-9393-15874ee76c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1156846589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d4423fe-f18a-4ae8-a1b3-e1f75ed77760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67809777a7334848a31071dcaedcfc15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:04:38Z,use_quota=True,user_id='0325fda463b64bd8bc0df54119f3fa44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29bbe5ea-2acd-4b5d-856c-6cd87514e85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29bbe5ea-2acd-4b5d-856c-6cd87514e85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (096851d4-9dd6-476c-8e04-6a9d484cb719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (096851d4-9dd6-476c-8e04-6a9d484cb719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d4423fe-f18a-4ae8-a1b3-e1f75ed77760', 'volume_name': 'volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0bbc490-44f1-46a2-b93a-2f442b2db267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0bbc490-44f1-46a2-b93a-2f442b2db267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa6f899-7e4c-458e-af15-b547a3645b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:38 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Volume 9d4423fe-f18a-4ae8-a1b3-e1f75ed77760: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760', 'volume_size': 1}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1156846589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d4423fe-f18a-4ae8-a1b3-e1f75ed77760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67809777a7334848a31071dcaedcfc15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:04:38Z,use_quota=True,user_id='0325fda463b64bd8bc0df54119f3fa44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Creating volume 9d4423fe-f18a-4ae8-a1b3-e1f75ed77760 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:04:38 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:38 devstack sudo[93790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760 1073741824
Sep 07 18:04:38 devstack sudo[93790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-034df3df-6407-4291-80b8-f0c5e36ab164 tempest-VolumesActionsTest-2130616910 None] Created reservations ['a851d30c-5e39-431d-ba92-6d7a7b3e9d42', 'ca1c9767-771d-44be-bc2e-7ecda3ab2efd', 'a0b7f41c-fc40-4e4a-9212-bbba98be9c9a', '48355c6f-bea5-4866-bb62-2380f1fed08d'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-034df3df-6407-4291-80b8-f0c5e36ab164 tempest-VolumesActionsTest-2130616910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-034df3df-6407-4291-80b8-f0c5e36ab164 tempest-VolumesActionsTest-2130616910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-034df3df-6407-4291-80b8-f0c5e36ab164 tempest-VolumesActionsTest-2130616910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-034df3df-6407-4291-80b8-f0c5e36ab164 tempest-VolumesActionsTest-2130616910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-034df3df-6407-4291-80b8-f0c5e36ab164 tempest-VolumesActionsTest-2130616910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-034df3df-6407-4291-80b8-f0c5e36ab164 tempest-VolumesActionsTest-2130616910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:38 devstack sudo[93792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:04:38 devstack sudo[93792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:39 devstack sudo[93792]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-034df3df-6407-4291-80b8-f0c5e36ab164 tempest-VolumesActionsTest-2130616910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.304s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:39 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-034df3df-6407-4291-80b8-f0c5e36ab164 tempest-VolumesActionsTest-2130616910 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:04:39 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-034df3df-6407-4291-80b8-f0c5e36ab164 tempest-VolumesActionsTest-2130616910 None] Deleted volume successfully.
Sep 07 18:04:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-034df3df-6407-4291-80b8-f0c5e36ab164 tempest-VolumesActionsTest-2130616910 None] Lock "cinder-2c3a2426-415b-4530-800b-74c4ac1930a2-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:39 devstack sudo[93790]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760 1073741824" returned: 0 in 0.592s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:39 devstack sudo[93801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760
Sep 07 18:04:39 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:39 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760" returned: 0 in 0.325s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:04:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa6f899-7e4c-458e-af15-b547a3645b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b5ac241-12f2-48b6-bba8-25a6f6f03037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:39 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Volume volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760 (9d4423fe-f18a-4ae8-a1b3-e1f75ed77760): created successfully
Sep 07 18:04:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b5ac241-12f2-48b6-bba8-25a6f6f03037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Flow 'volume_create_manager' (1aea08f4-0737-4a50-bfb4-26c7dc62f8b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:04:39 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-8ed83f1a-1abf-4fee-b4b4-064b6a4e230e tempest-VolumesSnapshotTestJSON-1640546916 None] Created volume successfully.
Sep 07 18:04:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f366c83a-8e5d-475f-acd3-6c2a41747270 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f366c83a-8e5d-475f-acd3-6c2a41747270 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-f366c83a-8e5d-475f-acd3-6c2a41747270 tempest-VolumesSnapshotTestJSON-1640546916 None] Creating offline snapshot cae3258b-965d-4a22-9be4-fb35017a5d0e of volume 9d4423fe-f18a-4ae8-a1b3-e1f75ed77760 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:04:40 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[46858b4a-f369-4627-a367-a719d791cffd]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:04:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f366c83a-8e5d-475f-acd3-6c2a41747270 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:41 devstack sudo[93809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760
Sep 07 18:04:41 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:41 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f366c83a-8e5d-475f-acd3-6c2a41747270 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760" returned: 0 in 0.424s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f366c83a-8e5d-475f-acd3-6c2a41747270 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.cae3258b-965d-4a22-9be4-fb35017a5d0e 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:41 devstack sudo[93814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.cae3258b-965d-4a22-9be4-fb35017a5d0e 1G
Sep 07 18:04:41 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:41 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f366c83a-8e5d-475f-acd3-6c2a41747270 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.cae3258b-965d-4a22-9be4-fb35017a5d0e 1G" returned: 0 in 0.595s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f366c83a-8e5d-475f-acd3-6c2a41747270 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.cae3258b-965d-4a22-9be4-fb35017a5d0e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:41 devstack sudo[93824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.cae3258b-965d-4a22-9be4-fb35017a5d0e
Sep 07 18:04:41 devstack sudo[93824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:42 devstack sudo[93824]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f366c83a-8e5d-475f-acd3-6c2a41747270 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.cae3258b-965d-4a22-9be4-fb35017a5d0e" returned: 0 in 0.445s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:42 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-f366c83a-8e5d-475f-acd3-6c2a41747270 tempest-VolumesSnapshotTestJSON-1640546916 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.cae3258b-965d-4a22-9be4-fb35017a5d0e is being set with open permissions: ugo+rw
Sep 07 18:04:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f366c83a-8e5d-475f-acd3-6c2a41747270 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.cae3258b-965d-4a22-9be4-fb35017a5d0e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:42 devstack sudo[93840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.cae3258b-965d-4a22-9be4-fb35017a5d0e
Sep 07 18:04:42 devstack sudo[93840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:42 devstack sudo[93840]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f366c83a-8e5d-475f-acd3-6c2a41747270 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.cae3258b-965d-4a22-9be4-fb35017a5d0e" returned: 0 in 0.295s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f366c83a-8e5d-475f-acd3-6c2a41747270 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:42 devstack sudo[93845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.info
Sep 07 18:04:42 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:43 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f366c83a-8e5d-475f-acd3-6c2a41747270 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.info" returned: 0 in 0.358s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:43 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-f366c83a-8e5d-475f-acd3-6c2a41747270 tempest-VolumesSnapshotTestJSON-1640546916 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.info is being set with open permissions: ugo+rw
Sep 07 18:04:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f366c83a-8e5d-475f-acd3-6c2a41747270 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:43 devstack sudo[93848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.info
Sep 07 18:04:43 devstack sudo[93848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:43 devstack sudo[93848]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f366c83a-8e5d-475f-acd3-6c2a41747270 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.info" returned: 0 in 0.256s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f366c83a-8e5d-475f-acd3-6c2a41747270 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.495s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:43 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f366c83a-8e5d-475f-acd3-6c2a41747270 tempest-VolumesSnapshotTestJSON-1640546916 None] Create snapshot completed successfully
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Flow 'volume_create_manager' (e9ccf0cc-a7df-46cf-9bf9-e3c0bf5527ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f9d8e69-ae9a-49c8-a2a9-b0c1851cf04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f9d8e69-ae9a-49c8-a2a9-b0c1851cf04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:04:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-589350977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe943ae4-ceda-4e41-8960-c8a894fad86d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67809777a7334848a31071dcaedcfc15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:04:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=cae3258b-965d-4a22-9be4-fb35017a5d0e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:04:45Z,use_quota=True,user_id='0325fda463b64bd8bc0df54119f3fa44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0750a8b-8d4f-4c6c-9a41-e68450913317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0750a8b-8d4f-4c6c-9a41-e68450913317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c71202-e296-41d3-a222-5621815d7ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c71202-e296-41d3-a222-5621815d7ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fe943ae4-ceda-4e41-8960-c8a894fad86d', 'volume_name': 'volume-fe943ae4-ceda-4e41-8960-c8a894fad86d', 'volume_size': 2, 'snapshot_id': 'cae3258b-965d-4a22-9be4-fb35017a5d0e'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4e6dbc-03e5-4a3d-a683-1428b1b4f54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4e6dbc-03e5-4a3d-a683-1428b1b4f54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b296b160-4a1a-4e7f-9693-dbac77c1e0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:44 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Volume fe943ae4-ceda-4e41-8960-c8a894fad86d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fe943ae4-ceda-4e41-8960-c8a894fad86d', 'volume_size': 2, 'snapshot_id': 'cae3258b-965d-4a22-9be4-fb35017a5d0e'}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "cinder-quobyte-cae3258b-965d-4a22-9be4-fb35017a5d0e-fe943ae4-ceda-4e41-8960-c8a894fad86d" by "_create_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-cae3258b-965d-4a22-9be4-fb35017a5d0e-fe943ae4-ceda-4e41-8960-c8a894fad86d" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Creating volume fe943ae4-ceda-4e41-8960-c8a894fad86d from snapshot cae3258b-965d-4a22-9be4-fb35017a5d0e {{(pid=87269) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "cinder-quobyte-fe943ae4-ceda-4e41-8960-c8a894fad86d" by "_copy_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-fe943ae4-ceda-4e41-8960-c8a894fad86d" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] snapshot: cae3258b-965d-4a22-9be4-fb35017a5d0e, volume: fe943ae4-ceda-4e41-8960-c8a894fad86d,  {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b14f1d1-3e6b-428a-ae64-6f2fea3221e9]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:04:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.cae3258b-965d-4a22-9be4-fb35017a5d0e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:45 devstack sudo[93851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.cae3258b-965d-4a22-9be4-fb35017a5d0e
Sep 07 18:04:45 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:45 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.cae3258b-965d-4a22-9be4-fb35017a5d0e" returned: 0 in 0.423s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:04:45 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a948118e-728c-4008-b03e-4331da7cb477]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:04:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:45 devstack sudo[93856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760
Sep 07 18:04:45 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:45 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760" returned: 0 in 0.424s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] will copy from snapshot at /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760 {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 07 18:04:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Creating direct copy from snapshot {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 07 18:04:45 devstack cinder-volume[87269]: DEBUG cinder.utils [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Path /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fe943ae4-ceda-4e41-8960-c8a894fad86d not found in is_blk_device check {{(pid=87269) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 07 18:04:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fe943ae4-ceda-4e41-8960-c8a894fad86d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:45 devstack sudo[93862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fe943ae4-ceda-4e41-8960-c8a894fad86d
Sep 07 18:04:45 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:51 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fe943ae4-ceda-4e41-8960-c8a894fad86d" returned: 0 in 6.170s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:51 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Image conversion details: src /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760, size 1024.00 MB, duration 6.17 sec, destination /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fe943ae4-ceda-4e41-8960-c8a894fad86d {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 07 18:04:51 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Converted 1024.00 MB image at 165.93 MB/s
Sep 07 18:04:51 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fe943ae4-ceda-4e41-8960-c8a894fad86d is being set with open permissions: ugo+rw
Sep 07 18:04:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fe943ae4-ceda-4e41-8960-c8a894fad86d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:51 devstack sudo[93876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fe943ae4-ceda-4e41-8960-c8a894fad86d
Sep 07 18:04:51 devstack sudo[93876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:52 devstack sudo[93876]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fe943ae4-ceda-4e41-8960-c8a894fad86d" returned: 0 in 0.248s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-fe943ae4-ceda-4e41-8960-c8a894fad86d" released by "_copy_volume_from_snapshot" :: held 7.363s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-cae3258b-965d-4a22-9be4-fb35017a5d0e-fe943ae4-ceda-4e41-8960-c8a894fad86d" released by "_create_volume_from_snapshot" :: held 7.436s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.464s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b296b160-4a1a-4e7f-9693-dbac77c1e0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe943ae4-ceda-4e41-8960-c8a894fad86d', 'volume_size': 2, 'snapshot_id': 'cae3258b-965d-4a22-9be4-fb35017a5d0e'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1215c75-b38e-45a8-bd49-a16d864e088b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:04:52 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Volume volume-fe943ae4-ceda-4e41-8960-c8a894fad86d (fe943ae4-ceda-4e41-8960-c8a894fad86d): created successfully
Sep 07 18:04:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1215c75-b38e-45a8-bd49-a16d864e088b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:04:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Flow 'volume_create_manager' (e9ccf0cc-a7df-46cf-9bf9-e3c0bf5527ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:04:52 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3dc4dc5c-ea61-4d16-b3b6-c5446b69aaf4 tempest-VolumesSnapshotTestJSON-1640546916 None] Created volume successfully.
Sep 07 18:04:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2bb13408-018d-4bcb-81ef-424fb604d3d8 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "cinder-fe943ae4-ceda-4e41-8960-c8a894fad86d-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2bb13408-018d-4bcb-81ef-424fb604d3d8 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-fe943ae4-ceda-4e41-8960-c8a894fad86d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2bb13408-018d-4bcb-81ef-424fb604d3d8 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "cinder-quobyte-fe943ae4-ceda-4e41-8960-c8a894fad86d" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2bb13408-018d-4bcb-81ef-424fb604d3d8 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-fe943ae4-ceda-4e41-8960-c8a894fad86d" acquired by "delete_volume" :: waited 0.036s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:53 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4403fe8e-6ec0-43cc-a5d9-581a9104b24a]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:04:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2bb13408-018d-4bcb-81ef-424fb604d3d8 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fe943ae4-ceda-4e41-8960-c8a894fad86d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:53 devstack sudo[93883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fe943ae4-ceda-4e41-8960-c8a894fad86d
Sep 07 18:04:53 devstack sudo[93883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:54 devstack sudo[93883]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2bb13408-018d-4bcb-81ef-424fb604d3d8 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fe943ae4-ceda-4e41-8960-c8a894fad86d" returned: 0 in 0.985s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2bb13408-018d-4bcb-81ef-424fb604d3d8 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fe943ae4-ceda-4e41-8960-c8a894fad86d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:54 devstack sudo[93947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fe943ae4-ceda-4e41-8960-c8a894fad86d
Sep 07 18:04:54 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:54 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2bb13408-018d-4bcb-81ef-424fb604d3d8 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fe943ae4-ceda-4e41-8960-c8a894fad86d" returned: 0 in 0.516s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2bb13408-018d-4bcb-81ef-424fb604d3d8 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-fe943ae4-ceda-4e41-8960-c8a894fad86d" released by "delete_volume" :: held 1.613s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:55 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-2bb13408-018d-4bcb-81ef-424fb604d3d8 tempest-VolumesSnapshotTestJSON-1640546916 None] Created reservations ['ae60ff72-a2ac-4d07-a015-3f5589437133', '420588c0-7d53-4c10-bc4e-df497345effb', 'f88baa5f-0a82-4d0c-a82c-a62013e899a0', '8d87df78-0b5e-4c4a-80da-4445e48b447a'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:04:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2bb13408-018d-4bcb-81ef-424fb604d3d8 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:04:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2bb13408-018d-4bcb-81ef-424fb604d3d8 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:04:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2bb13408-018d-4bcb-81ef-424fb604d3d8 tempest-VolumesSnapshotTestJSON-1640546916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:04:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2bb13408-018d-4bcb-81ef-424fb604d3d8 tempest-VolumesSnapshotTestJSON-1640546916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:04:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2bb13408-018d-4bcb-81ef-424fb604d3d8 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:04:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2bb13408-018d-4bcb-81ef-424fb604d3d8 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:55 devstack sudo[93960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:04:55 devstack sudo[93960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:55 devstack sudo[93960]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2bb13408-018d-4bcb-81ef-424fb604d3d8 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.763s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:55 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-2bb13408-018d-4bcb-81ef-424fb604d3d8 tempest-VolumesSnapshotTestJSON-1640546916 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:04:55 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2bb13408-018d-4bcb-81ef-424fb604d3d8 tempest-VolumesSnapshotTestJSON-1640546916 None] Deleted volume successfully.
Sep 07 18:04:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0ba7f159-dd0c-4288-95a7-e47c25ee581f tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "cinder-cae3258b-965d-4a22-9be4-fb35017a5d0e-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2bb13408-018d-4bcb-81ef-424fb604d3d8 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-fe943ae4-ceda-4e41-8960-c8a894fad86d-delete_volume" released by "delete_volume" :: held 2.860s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0ba7f159-dd0c-4288-95a7-e47c25ee581f tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-cae3258b-965d-4a22-9be4-fb35017a5d0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0ba7f159-dd0c-4288-95a7-e47c25ee581f tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "cinder-quobyte-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0ba7f159-dd0c-4288-95a7-e47c25ee581f tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0ba7f159-dd0c-4288-95a7-e47c25ee581f tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "cinder-quobyte-cae3258b-965d-4a22-9be4-fb35017a5d0e" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:04:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0ba7f159-dd0c-4288-95a7-e47c25ee581f tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-cae3258b-965d-4a22-9be4-fb35017a5d0e" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:04:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-0ba7f159-dd0c-4288-95a7-e47c25ee581f tempest-VolumesSnapshotTestJSON-1640546916 None] Deleting offline snapshot cae3258b-965d-4a22-9be4-fb35017a5d0e of volume 9d4423fe-f18a-4ae8-a1b3-e1f75ed77760 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:04:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-0ba7f159-dd0c-4288-95a7-e47c25ee581f tempest-VolumesSnapshotTestJSON-1640546916 None] snapshot_file for this snap is: volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.cae3258b-965d-4a22-9be4-fb35017a5d0e {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:04:56 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7e115f-2aa3-4657-82ff-cf79eb42c96b]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:04:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0ba7f159-dd0c-4288-95a7-e47c25ee581f tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.cae3258b-965d-4a22-9be4-fb35017a5d0e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:56 devstack sudo[93972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.cae3258b-965d-4a22-9be4-fb35017a5d0e
Sep 07 18:04:56 devstack sudo[93972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:57 devstack sudo[93972]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0ba7f159-dd0c-4288-95a7-e47c25ee581f tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.cae3258b-965d-4a22-9be4-fb35017a5d0e" returned: 0 in 0.788s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:57 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-0ba7f159-dd0c-4288-95a7-e47c25ee581f tempest-VolumesSnapshotTestJSON-1640546916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:04:57 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5179d7f5-25ab-4e90-9d59-9a930871ee10]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:04:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0ba7f159-dd0c-4288-95a7-e47c25ee581f tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:57 devstack sudo[93988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760
Sep 07 18:04:57 devstack sudo[93988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:58 devstack sudo[93988]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0ba7f159-dd0c-4288-95a7-e47c25ee581f tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760" returned: 0 in 1.138s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0ba7f159-dd0c-4288-95a7-e47c25ee581f tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.cae3258b-965d-4a22-9be4-fb35017a5d0e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:58 devstack sudo[94001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.cae3258b-965d-4a22-9be4-fb35017a5d0e
Sep 07 18:04:58 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:58 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0ba7f159-dd0c-4288-95a7-e47c25ee581f tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.cae3258b-965d-4a22-9be4-fb35017a5d0e" returned: 0 in 0.494s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0ba7f159-dd0c-4288-95a7-e47c25ee581f tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.cae3258b-965d-4a22-9be4-fb35017a5d0e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:04:58 devstack sudo[94006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.cae3258b-965d-4a22-9be4-fb35017a5d0e
Sep 07 18:04:58 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:04:59 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root
Sep 07 18:04:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0ba7f159-dd0c-4288-95a7-e47c25ee581f tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760.cae3258b-965d-4a22-9be4-fb35017a5d0e" returned: 0 in 0.455s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:04:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0ba7f159-dd0c-4288-95a7-e47c25ee581f tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-cae3258b-965d-4a22-9be4-fb35017a5d0e" released by "_delete_snapshot" :: held 3.159s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0ba7f159-dd0c-4288-95a7-e47c25ee581f tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760" released by "delete_snapshot" :: held 3.212s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:04:59 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-0ba7f159-dd0c-4288-95a7-e47c25ee581f tempest-VolumesSnapshotTestJSON-1640546916 None] Created reservations ['375be0c5-b8af-428e-b509-0bfc96862055', '2d0f9ef9-42e8-46dc-abf8-708f8dad6e24', 'f18f08ce-15e7-422b-a342-d7974f757b74', '13cd72a5-a6c6-470e-b67a-8feaa13075b9'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:04:59 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0ba7f159-dd0c-4288-95a7-e47c25ee581f tempest-VolumesSnapshotTestJSON-1640546916 None] Delete snapshot completed successfully.
Sep 07 18:04:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0ba7f159-dd0c-4288-95a7-e47c25ee581f tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-cae3258b-965d-4a22-9be4-fb35017a5d0e-delete_snapshot" released by "delete_snapshot" :: held 3.423s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-76bfcd28-e7b7-43ee-966a-7b4ce59a2a77 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "cinder-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-76bfcd28-e7b7-43ee-966a-7b4ce59a2a77 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-76bfcd28-e7b7-43ee-966a-7b4ce59a2a77 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "cinder-quobyte-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:00 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:05:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:05:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:05:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-76bfcd28-e7b7-43ee-966a-7b4ce59a2a77 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760" acquired by "delete_volume" :: waited 0.138s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:00 devstack sudo[94060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:05:00 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:01 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e3ad76-5654-4284-95b7-c1ba95bba520]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:05:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-76bfcd28-e7b7-43ee-966a-7b4ce59a2a77 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:01 devstack sudo[94062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760
Sep 07 18:05:01 devstack sudo[94062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:01 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.617s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:05:01 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:05:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 07 18:05:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread info: [<_MainThread(MainThread, started 137533762306176)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137533650971072)>, <Thread(Thread-3 (stat_writer), started daemon 137533647226880)>, <Thread(Rabbit-heartbeat, started daemon 137533647437120)>, <Thread(Thread-5 (_runner), started daemon 137533648120896)>, <Thread(Thread-7 (_runner), started daemon 137533648182592)>, <Thread(fd_logger, started daemon 137533644336576)>, <Thread(privsep_reader, started daemon 137533643255424)>, <Thread(tpool_thread_0, started daemon 137533635446464)>, <Thread(tpool_thread_1, started daemon 137533627053760)>, <Thread(tpool_thread_2, started daemon 137533618661056)>, <Thread(tpool_thread_3, started daemon 137533610251968)>, <Thread(tpool_thread_4, started daemon 137533601842880)>, <Thread(tpool_thread_5, started daemon 137533593433792)>, <Thread(tpool_thread_6, started daemon 137533585024704)>, <Thread(tpool_thread_7, started daemon 137533576615616)>, <Thread(tpool_thread_8, started daemon 137533568206528)>, <Thread(tpool_thread_9, started daemon 137533559797440)>, <Thread(tpool_thread_10, started daemon 137533551388352)>, <Thread(tpool_thread_11, started daemon 137533542979264)>, <Thread(tpool_thread_12, started daemon 137533534570176)>, <Thread(tpool_thread_13, started daemon 137533526161088)>, <Thread(tpool_thread_14, started daemon 137533517752000)>, <Thread(tpool_thread_15, started daemon 137533509342912)>, <Thread(tpool_thread_16, started daemon 137533500933824)>, <Thread(tpool_thread_17, started daemon 137533492524736)>, <Thread(tpool_thread_18, started daemon 137533484115648)>, <Thread(tpool_thread_19, started daemon 137533475706560)>] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 07 18:05:01 devstack sudo[94062]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-76bfcd28-e7b7-43ee-966a-7b4ce59a2a77 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760" returned: 0 in 0.845s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-76bfcd28-e7b7-43ee-966a-7b4ce59a2a77 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:01 devstack sudo[94076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760
Sep 07 18:05:01 devstack sudo[94076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:02 devstack sudo[94076]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-76bfcd28-e7b7-43ee-966a-7b4ce59a2a77 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760" returned: 0 in 0.388s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-76bfcd28-e7b7-43ee-966a-7b4ce59a2a77 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760" released by "delete_volume" :: held 1.357s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:02 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-76bfcd28-e7b7-43ee-966a-7b4ce59a2a77 tempest-VolumesSnapshotTestJSON-1640546916 None] Created reservations ['adf1f2a0-61db-4765-8446-a58354b05738', 'c22f6179-3a44-4d30-b666-a650e4f71f1e', 'f6437490-e2c3-485a-91c4-3041275e2e95', '64573ee6-991a-4278-9d1f-7b9256b45df1'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:05:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-76bfcd28-e7b7-43ee-966a-7b4ce59a2a77 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-76bfcd28-e7b7-43ee-966a-7b4ce59a2a77 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-76bfcd28-e7b7-43ee-966a-7b4ce59a2a77 tempest-VolumesSnapshotTestJSON-1640546916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:05:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-76bfcd28-e7b7-43ee-966a-7b4ce59a2a77 tempest-VolumesSnapshotTestJSON-1640546916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:05:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-76bfcd28-e7b7-43ee-966a-7b4ce59a2a77 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-76bfcd28-e7b7-43ee-966a-7b4ce59a2a77 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:02 devstack sudo[94079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:05:02 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:02 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-76bfcd28-e7b7-43ee-966a-7b4ce59a2a77 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.460s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:02 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-76bfcd28-e7b7-43ee-966a-7b4ce59a2a77 tempest-VolumesSnapshotTestJSON-1640546916 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:05:02 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-76bfcd28-e7b7-43ee-966a-7b4ce59a2a77 tempest-VolumesSnapshotTestJSON-1640546916 None] Deleted volume successfully.
Sep 07 18:05:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-76bfcd28-e7b7-43ee-966a-7b4ce59a2a77 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-9d4423fe-f18a-4ae8-a1b3-e1f75ed77760-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:03 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:05:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Flow 'volume_create_manager' (0f132bb6-23db-464a-a067-1576c3d11dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:05:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e321b6-424b-4a85-a62c-7ad0c837fd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e321b6-424b-4a85-a62c-7ad0c837fd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-117116439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92191068-9599-438f-a55f-888044213526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67809777a7334848a31071dcaedcfc15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:05:04Z,use_quota=True,user_id='0325fda463b64bd8bc0df54119f3fa44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d5970c-6d68-4c7c-a4dd-d93c512a16fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d5970c-6d68-4c7c-a4dd-d93c512a16fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801b982f-5224-4873-8825-a38c9917bd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801b982f-5224-4873-8825-a38c9917bd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92191068-9599-438f-a55f-888044213526', 'volume_name': 'volume-92191068-9599-438f-a55f-888044213526', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5be34f74-a9ac-4667-85b6-584ed066381b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5be34f74-a9ac-4667-85b6-584ed066381b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da263ed2-3f03-4cc6-80af-c09fe88d4769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:04 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Volume 92191068-9599-438f-a55f-888044213526: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92191068-9599-438f-a55f-888044213526', 'volume_size': 1}
Sep 07 18:05:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-117116439',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92191068-9599-438f-a55f-888044213526,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67809777a7334848a31071dcaedcfc15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:05:04Z,use_quota=True,user_id='0325fda463b64bd8bc0df54119f3fa44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:05:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Creating volume 92191068-9599-438f-a55f-888044213526 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:05:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:05:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:05:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:05:04 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:05:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:04 devstack sudo[94085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526 1073741824
Sep 07 18:05:04 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:05 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526 1073741824" returned: 0 in 1.118s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:05 devstack sudo[94147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526
Sep 07 18:05:05 devstack sudo[94147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:05 devstack sudo[94147]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526" returned: 0 in 0.566s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:05:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da263ed2-3f03-4cc6-80af-c09fe88d4769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92191068-9599-438f-a55f-888044213526', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a21cdfe-a98a-4f2b-9c5e-d9db87679864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:05 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Volume volume-92191068-9599-438f-a55f-888044213526 (92191068-9599-438f-a55f-888044213526): created successfully
Sep 07 18:05:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a21cdfe-a98a-4f2b-9c5e-d9db87679864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Flow 'volume_create_manager' (0f132bb6-23db-464a-a067-1576c3d11dc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:05:06 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-881b8470-ad90-4c7c-837b-19029bdb6c31 tempest-VolumesSnapshotTestJSON-1640546916 None] Created volume successfully.
Sep 07 18:05:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-389aac3f-7877-4530-8710-f16885b9bfef tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-389aac3f-7877-4530-8710-f16885b9bfef tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-389aac3f-7877-4530-8710-f16885b9bfef tempest-VolumesSnapshotTestJSON-1640546916 None] Creating offline snapshot 4b8c33d2-0a94-434e-a022-4544abd686f5 of volume 92191068-9599-438f-a55f-888044213526 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:05:07 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ceb0a74-3c9d-4b5d-9c5e-bfc5aaa2faa7]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:05:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-389aac3f-7877-4530-8710-f16885b9bfef tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:07 devstack sudo[94200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526
Sep 07 18:05:07 devstack sudo[94200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:08 devstack sudo[94200]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-389aac3f-7877-4530-8710-f16885b9bfef tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526" returned: 0 in 1.277s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-389aac3f-7877-4530-8710-f16885b9bfef tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.4b8c33d2-0a94-434e-a022-4544abd686f5 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:08 devstack sudo[94208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.4b8c33d2-0a94-434e-a022-4544abd686f5 1G
Sep 07 18:05:08 devstack sudo[94208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:09 devstack sudo[94208]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-389aac3f-7877-4530-8710-f16885b9bfef tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.4b8c33d2-0a94-434e-a022-4544abd686f5 1G" returned: 0 in 1.196s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-389aac3f-7877-4530-8710-f16885b9bfef tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92191068-9599-438f-a55f-888044213526 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.4b8c33d2-0a94-434e-a022-4544abd686f5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:09 devstack sudo[94238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92191068-9599-438f-a55f-888044213526 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.4b8c33d2-0a94-434e-a022-4544abd686f5
Sep 07 18:05:09 devstack sudo[94238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:10 devstack sudo[94238]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-389aac3f-7877-4530-8710-f16885b9bfef tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92191068-9599-438f-a55f-888044213526 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.4b8c33d2-0a94-434e-a022-4544abd686f5" returned: 0 in 0.561s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:10 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-389aac3f-7877-4530-8710-f16885b9bfef tempest-VolumesSnapshotTestJSON-1640546916 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.4b8c33d2-0a94-434e-a022-4544abd686f5 is being set with open permissions: ugo+rw
Sep 07 18:05:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-389aac3f-7877-4530-8710-f16885b9bfef tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.4b8c33d2-0a94-434e-a022-4544abd686f5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:10 devstack sudo[94244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.4b8c33d2-0a94-434e-a022-4544abd686f5
Sep 07 18:05:10 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:10 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-389aac3f-7877-4530-8710-f16885b9bfef tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.4b8c33d2-0a94-434e-a022-4544abd686f5" returned: 0 in 0.315s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:10 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=94,cinder:INSERT=35,cinder:UPDATE=121,cinder:DELETE=12 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:05:10 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=123,cinder:SELECT=97,cinder:INSERT=24,cinder:DELETE=9 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:05:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-389aac3f-7877-4530-8710-f16885b9bfef tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:10 devstack sudo[94247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.info
Sep 07 18:05:10 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:10 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-389aac3f-7877-4530-8710-f16885b9bfef tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.info" returned: 0 in 0.413s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:10 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-389aac3f-7877-4530-8710-f16885b9bfef tempest-VolumesSnapshotTestJSON-1640546916 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.info is being set with open permissions: ugo+rw
Sep 07 18:05:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-389aac3f-7877-4530-8710-f16885b9bfef tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:10 devstack sudo[94250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.info
Sep 07 18:05:10 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:11 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-389aac3f-7877-4530-8710-f16885b9bfef tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.info" returned: 0 in 0.454s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-389aac3f-7877-4530-8710-f16885b9bfef tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.437s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:11 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-389aac3f-7877-4530-8710-f16885b9bfef tempest-VolumesSnapshotTestJSON-1640546916 None] Create snapshot completed successfully
Sep 07 18:05:12 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:05:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Flow 'volume_create_manager' (22477938-31a0-4c36-87a1-b4d723be779e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:05:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2cf8ddb-a602-4c7a-9855-7c2a0dfa56ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2cf8ddb-a602-4c7a-9855-7c2a0dfa56ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-42740581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f78452ef-55b1-45f8-b3f8-b72c3fdee61f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1615f6282e5470facee00bad5b4146b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:05:12Z,use_quota=True,user_id='8eb40f0a93ff4e0fa619385d1a8c8085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e7e4449-ba15-402e-9c4d-073ff8dd9147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e7e4449-ba15-402e-9c4d-073ff8dd9147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2768b929-47ee-4cf9-a3d2-50d31748f060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2768b929-47ee-4cf9-a3d2-50d31748f060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f78452ef-55b1-45f8-b3f8-b72c3fdee61f', 'volume_name': 'volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9de61fa-15e4-4f84-9659-34ee34331bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9de61fa-15e4-4f84-9659-34ee34331bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77075b38-f61a-43dd-baea-168494ea12f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:12 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Volume f78452ef-55b1-45f8-b3f8-b72c3fdee61f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f', 'volume_size': 1}
Sep 07 18:05:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-42740581',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f78452ef-55b1-45f8-b3f8-b72c3fdee61f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1615f6282e5470facee00bad5b4146b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:05:12Z,use_quota=True,user_id='8eb40f0a93ff4e0fa619385d1a8c8085',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:05:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Creating volume f78452ef-55b1-45f8-b3f8-b72c3fdee61f {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:05:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:05:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:05:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:05:12 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:05:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:12 devstack sudo[94254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f 1073741824
Sep 07 18:05:12 devstack sudo[94254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:12 devstack sudo[94254]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f 1073741824" returned: 0 in 0.698s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:12 devstack sudo[94261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f
Sep 07 18:05:12 devstack sudo[94261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Flow 'volume_create_manager' (34234a8b-adb6-492c-a2be-d10e92f38a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f70b13-7282-4f32-8933-9bb17e98619a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f70b13-7282-4f32-8933-9bb17e98619a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1786306700',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e4c381-b0ea-4177-9f40-d4b81fbc1fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67809777a7334848a31071dcaedcfc15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4b8c33d2-0a94-434e-a022-4544abd686f5,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:05:13Z,use_quota=True,user_id='0325fda463b64bd8bc0df54119f3fa44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee560d49-2a94-46e7-a768-6f4357e43f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee560d49-2a94-46e7-a768-6f4357e43f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d9a042-2cf8-43a6-9773-c32e20ee9ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d9a042-2cf8-43a6-9773-c32e20ee9ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '75e4c381-b0ea-4177-9f40-d4b81fbc1fe6', 'volume_name': 'volume-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6', 'volume_size': 1, 'snapshot_id': '4b8c33d2-0a94-434e-a022-4544abd686f5'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de99f3ec-8640-4143-ae9c-e46d3f74e48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de99f3ec-8640-4143-ae9c-e46d3f74e48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:13 devstack sudo[94261]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2408a75c-b562-4270-a757-9e4b97f927e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:13 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Volume 75e4c381-b0ea-4177-9f40-d4b81fbc1fe6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6', 'volume_size': 1, 'snapshot_id': '4b8c33d2-0a94-434e-a022-4544abd686f5'}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f" returned: 0 in 0.335s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77075b38-f61a-43dd-baea-168494ea12f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af1da6d-9075-467e-ab23-552accdb75c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "cinder-quobyte-4b8c33d2-0a94-434e-a022-4544abd686f5-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6" by "_create_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:13 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Volume volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f (f78452ef-55b1-45f8-b3f8-b72c3fdee61f): created successfully
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4af1da6d-9075-467e-ab23-552accdb75c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Flow 'volume_create_manager' (22477938-31a0-4c36-87a1-b4d723be779e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-4b8c33d2-0a94-434e-a022-4544abd686f5-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Creating volume 75e4c381-b0ea-4177-9f40-d4b81fbc1fe6 from snapshot 4b8c33d2-0a94-434e-a022-4544abd686f5 {{(pid=87269) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "cinder-quobyte-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6" by "_copy_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:13 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-66e0de3e-5531-4a8b-8db3-df7075b9b737 tempest-SnapshotMetadataTestJSON-816653332 None] Created volume successfully.
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] snapshot: 4b8c33d2-0a94-434e-a022-4544abd686f5, volume: 75e4c381-b0ea-4177-9f40-d4b81fbc1fe6,  {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e6c8b0-d38e-4662-a12a-2e4eb2e423b1]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.4b8c33d2-0a94-434e-a022-4544abd686f5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:13 devstack sudo[94278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.4b8c33d2-0a94-434e-a022-4544abd686f5
Sep 07 18:05:13 devstack sudo[94278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:13 devstack sudo[94278]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.4b8c33d2-0a94-434e-a022-4544abd686f5" returned: 0 in 0.491s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92191068-9599-438f-a55f-888044213526(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[843d22da-79d5-4dca-81f0-7ab7aaba4345]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:05:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:14 devstack sudo[94305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526
Sep 07 18:05:14 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f00e74c5-f5d9-43f9-aa84-76a51fa0124b tempest-SnapshotMetadataTestJSON-816653332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:14 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526" returned: 0 in 0.517s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] will copy from snapshot at /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526 {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 07 18:05:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Creating direct copy from snapshot {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 07 18:05:14 devstack cinder-volume[87269]: DEBUG cinder.utils [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Path /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6 not found in is_blk_device check {{(pid=87269) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 07 18:05:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:14 devstack sudo[94312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6
Sep 07 18:05:14 devstack sudo[94312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:20 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:05:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Flow 'volume_create_manager' (dc81fd56-de13-42e9-9b49-0123cb2750bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:05:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677448da-e12c-4baf-95b5-0cbc408ac114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (677448da-e12c-4baf-95b5-0cbc408ac114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-564907842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69179179-c6aa-45c1-9c46-bba07624d131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='168b8b2bce0846a799f04ef65c1d857b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:05:20Z,use_quota=True,user_id='ac33eda6b9a846ba91f6d5abf424cb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9a3c02-080e-4af4-95fd-df82b57359f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9a3c02-080e-4af4-95fd-df82b57359f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb28ffd0-02a6-4ee6-8000-7e909aa565e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb28ffd0-02a6-4ee6-8000-7e909aa565e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69179179-c6aa-45c1-9c46-bba07624d131', 'volume_name': 'volume-69179179-c6aa-45c1-9c46-bba07624d131', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b0edac2-565b-4882-9a06-b5de4b9626eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b0edac2-565b-4882-9a06-b5de4b9626eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5324f3-01de-477c-9b9d-8c8679e46174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:20 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Volume 69179179-c6aa-45c1-9c46-bba07624d131: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69179179-c6aa-45c1-9c46-bba07624d131', 'volume_size': 1}
Sep 07 18:05:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:22 devstack sudo[94312]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6" returned: 0 in 7.801s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:22 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Image conversion details: src /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526, size 1024.00 MB, duration 7.80 sec, destination /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 07 18:05:22 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Converted 1024.00 MB image at 131.24 MB/s
Sep 07 18:05:22 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6 is being set with open permissions: ugo+rw
Sep 07 18:05:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:22 devstack sudo[94330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6
Sep 07 18:05:22 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:22 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6" returned: 0 in 0.390s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6" released by "_copy_volume_from_snapshot" :: held 9.348s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-4b8c33d2-0a94-434e-a022-4544abd686f5-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6" released by "_create_volume_from_snapshot" :: held 9.463s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.509s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f00e74c5-f5d9-43f9-aa84-76a51fa0124b tempest-SnapshotMetadataTestJSON-816653332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.498s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-f00e74c5-f5d9-43f9-aa84-76a51fa0124b tempest-SnapshotMetadataTestJSON-816653332 None] Creating offline snapshot ee5bf974-f37f-43d2-b373-c2d22e69da98 of volume f78452ef-55b1-45f8-b3f8-b72c3fdee61f {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:05:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2408a75c-b562-4270-a757-9e4b97f927e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6', 'volume_size': 1, 'snapshot_id': '4b8c33d2-0a94-434e-a022-4544abd686f5'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9908c747-4248-4eda-88f5-5fb7c4521c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:22 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2cf2d9-cffd-4db5-8255-870691f19e23]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:05:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f00e74c5-f5d9-43f9-aa84-76a51fa0124b tempest-SnapshotMetadataTestJSON-816653332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:22 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Volume volume-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6 (75e4c381-b0ea-4177-9f40-d4b81fbc1fe6): created successfully
Sep 07 18:05:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9908c747-4248-4eda-88f5-5fb7c4521c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Flow 'volume_create_manager' (34234a8b-adb6-492c-a2be-d10e92f38a7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:05:22 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:05:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Flow 'volume_create_manager' (85f7947b-d5c6-45cd-bfb2-49595e4a10d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:05:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97f7d37-07f4-47c9-9862-8b33df2069b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:23 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4b70af8c-8163-48dd-8731-14434d3da468 tempest-VolumesSnapshotTestJSON-1640546916 None] Created volume successfully.
Sep 07 18:05:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d97f7d37-07f4-47c9-9862-8b33df2069b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-194483246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d106bea-32d3-4b32-a54d-5e6e830f17b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85fae6fc5a984195b885113b202c7d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:05:23Z,use_quota=True,user_id='46e1c75cede042baaf0c1704f089e208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:23 devstack sudo[94339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f
Sep 07 18:05:23 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b34c64f6-2f43-43ff-8fe0-582a42e1dd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b34c64f6-2f43-43ff-8fe0-582a42e1dd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f3ebd1-8a49-4e41-990d-695614621e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09f3ebd1-8a49-4e41-990d-695614621e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d106bea-32d3-4b32-a54d-5e6e830f17b4', 'volume_name': 'volume-8d106bea-32d3-4b32-a54d-5e6e830f17b4', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab4ee63b-8499-414a-bd7b-6004b48296a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab4ee63b-8499-414a-bd7b-6004b48296a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1001f4d3-6633-46f9-9ac6-df9e9a69d77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:23 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Volume 8d106bea-32d3-4b32-a54d-5e6e830f17b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d106bea-32d3-4b32-a54d-5e6e830f17b4', 'volume_size': 1}
Sep 07 18:05:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:23 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f00e74c5-f5d9-43f9-aa84-76a51fa0124b tempest-SnapshotMetadataTestJSON-816653332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f" returned: 0 in 0.488s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f00e74c5-f5d9-43f9-aa84-76a51fa0124b tempest-SnapshotMetadataTestJSON-816653332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f.ee5bf974-f37f-43d2-b373-c2d22e69da98 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:23 devstack sudo[94363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f.ee5bf974-f37f-43d2-b373-c2d22e69da98 1G
Sep 07 18:05:23 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:23 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f00e74c5-f5d9-43f9-aa84-76a51fa0124b tempest-SnapshotMetadataTestJSON-816653332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f.ee5bf974-f37f-43d2-b373-c2d22e69da98 1G" returned: 0 in 0.472s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f00e74c5-f5d9-43f9-aa84-76a51fa0124b tempest-SnapshotMetadataTestJSON-816653332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f.ee5bf974-f37f-43d2-b373-c2d22e69da98 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:23 devstack sudo[94368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f.ee5bf974-f37f-43d2-b373-c2d22e69da98
Sep 07 18:05:23 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9cb80364-ae82-46de-a8a2-90c8864ce701 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "cinder-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9cb80364-ae82-46de-a8a2-90c8864ce701 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9cb80364-ae82-46de-a8a2-90c8864ce701 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "cinder-quobyte-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9cb80364-ae82-46de-a8a2-90c8864ce701 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6" acquired by "delete_volume" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:24 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfd136c-19ef-4295-8f56-b078f7d8cebf]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:05:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9cb80364-ae82-46de-a8a2-90c8864ce701 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:24 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f00e74c5-f5d9-43f9-aa84-76a51fa0124b tempest-SnapshotMetadataTestJSON-816653332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f.ee5bf974-f37f-43d2-b373-c2d22e69da98" returned: 0 in 0.359s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:24 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-f00e74c5-f5d9-43f9-aa84-76a51fa0124b tempest-SnapshotMetadataTestJSON-816653332 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f.ee5bf974-f37f-43d2-b373-c2d22e69da98 is being set with open permissions: ugo+rw
Sep 07 18:05:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f00e74c5-f5d9-43f9-aa84-76a51fa0124b tempest-SnapshotMetadataTestJSON-816653332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f.ee5bf974-f37f-43d2-b373-c2d22e69da98 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:24 devstack sudo[94374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f.ee5bf974-f37f-43d2-b373-c2d22e69da98
Sep 07 18:05:24 devstack sudo[94374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:24 devstack sudo[94373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6
Sep 07 18:05:24 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:24 devstack sudo[94374]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f00e74c5-f5d9-43f9-aa84-76a51fa0124b tempest-SnapshotMetadataTestJSON-816653332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f.ee5bf974-f37f-43d2-b373-c2d22e69da98" returned: 0 in 0.257s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f00e74c5-f5d9-43f9-aa84-76a51fa0124b tempest-SnapshotMetadataTestJSON-816653332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:24 devstack sudo[94380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f.info
Sep 07 18:05:24 devstack sudo[94380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:24 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9cb80364-ae82-46de-a8a2-90c8864ce701 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6" returned: 0 in 0.414s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9cb80364-ae82-46de-a8a2-90c8864ce701 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:24 devstack sudo[94383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6
Sep 07 18:05:24 devstack sudo[94383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:24 devstack sudo[94380]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f00e74c5-f5d9-43f9-aa84-76a51fa0124b tempest-SnapshotMetadataTestJSON-816653332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f.info" returned: 0 in 0.263s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:24 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-f00e74c5-f5d9-43f9-aa84-76a51fa0124b tempest-SnapshotMetadataTestJSON-816653332 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f.info is being set with open permissions: ugo+rw
Sep 07 18:05:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f00e74c5-f5d9-43f9-aa84-76a51fa0124b tempest-SnapshotMetadataTestJSON-816653332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:24 devstack sudo[94386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f.info
Sep 07 18:05:24 devstack sudo[94386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:24 devstack sudo[94383]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9cb80364-ae82-46de-a8a2-90c8864ce701 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6" returned: 0 in 0.300s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9cb80364-ae82-46de-a8a2-90c8864ce701 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6" released by "delete_volume" :: held 0.760s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:24 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-9cb80364-ae82-46de-a8a2-90c8864ce701 tempest-VolumesSnapshotTestJSON-1640546916 None] Created reservations ['18c15bda-a17a-43d2-8ef3-a667c40f3aee', '38fa15e7-36de-4734-b179-1e9de01fd82c', '4e5eb2e1-c78d-471b-bfbe-88b02e1aa441', '09486f67-16f7-43ee-8cfd-7db0732bd879'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9cb80364-ae82-46de-a8a2-90c8864ce701 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9cb80364-ae82-46de-a8a2-90c8864ce701 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9cb80364-ae82-46de-a8a2-90c8864ce701 tempest-VolumesSnapshotTestJSON-1640546916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9cb80364-ae82-46de-a8a2-90c8864ce701 tempest-VolumesSnapshotTestJSON-1640546916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9cb80364-ae82-46de-a8a2-90c8864ce701 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9cb80364-ae82-46de-a8a2-90c8864ce701 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:25 devstack sudo[94390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:05:25 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:25 devstack sudo[94386]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f00e74c5-f5d9-43f9-aa84-76a51fa0124b tempest-SnapshotMetadataTestJSON-816653332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f.info" returned: 0 in 0.333s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f00e74c5-f5d9-43f9-aa84-76a51fa0124b tempest-SnapshotMetadataTestJSON-816653332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.312s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.166s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-564907842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69179179-c6aa-45c1-9c46-bba07624d131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='168b8b2bce0846a799f04ef65c1d857b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:05:20Z,use_quota=True,user_id='ac33eda6b9a846ba91f6d5abf424cb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Creating volume 69179179-c6aa-45c1-9c46-bba07624d131 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:05:25 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-69179179-c6aa-45c1-9c46-bba07624d131 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:25 devstack sudo[94392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-69179179-c6aa-45c1-9c46-bba07624d131 1073741824
Sep 07 18:05:25 devstack sudo[94392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:25 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f00e74c5-f5d9-43f9-aa84-76a51fa0124b tempest-SnapshotMetadataTestJSON-816653332 None] Create snapshot completed successfully
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5a115b0b-5948-4e39-afd4-87e57f98cd97 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "cinder-4b8c33d2-0a94-434e-a022-4544abd686f5-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5a115b0b-5948-4e39-afd4-87e57f98cd97 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-4b8c33d2-0a94-434e-a022-4544abd686f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5a115b0b-5948-4e39-afd4-87e57f98cd97 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "cinder-quobyte-92191068-9599-438f-a55f-888044213526" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5a115b0b-5948-4e39-afd4-87e57f98cd97 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-92191068-9599-438f-a55f-888044213526" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5a115b0b-5948-4e39-afd4-87e57f98cd97 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "cinder-quobyte-4b8c33d2-0a94-434e-a022-4544abd686f5" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:25 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9cb80364-ae82-46de-a8a2-90c8864ce701 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.334s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-9cb80364-ae82-46de-a8a2-90c8864ce701 tempest-VolumesSnapshotTestJSON-1640546916 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5a115b0b-5948-4e39-afd4-87e57f98cd97 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-4b8c33d2-0a94-434e-a022-4544abd686f5" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-5a115b0b-5948-4e39-afd4-87e57f98cd97 tempest-VolumesSnapshotTestJSON-1640546916 None] Deleting offline snapshot 4b8c33d2-0a94-434e-a022-4544abd686f5 of volume 92191068-9599-438f-a55f-888044213526 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-5a115b0b-5948-4e39-afd4-87e57f98cd97 tempest-VolumesSnapshotTestJSON-1640546916 None] snapshot_file for this snap is: volume-92191068-9599-438f-a55f-888044213526.4b8c33d2-0a94-434e-a022-4544abd686f5 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:05:25 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9cb80364-ae82-46de-a8a2-90c8864ce701 tempest-VolumesSnapshotTestJSON-1640546916 None] Deleted volume successfully.
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67a702d-44b0-4107-a274-bf66a6277bf4]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5a115b0b-5948-4e39-afd4-87e57f98cd97 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.4b8c33d2-0a94-434e-a022-4544abd686f5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9cb80364-ae82-46de-a8a2-90c8864ce701 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-75e4c381-b0ea-4177-9f40-d4b81fbc1fe6-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:25 devstack sudo[94395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.4b8c33d2-0a94-434e-a022-4544abd686f5
Sep 07 18:05:25 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:25 devstack sudo[94392]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-69179179-c6aa-45c1-9c46-bba07624d131 1073741824" returned: 0 in 0.641s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-69179179-c6aa-45c1-9c46-bba07624d131 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:25 devstack sudo[94403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-69179179-c6aa-45c1-9c46-bba07624d131
Sep 07 18:05:25 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:26 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5a115b0b-5948-4e39-afd4-87e57f98cd97 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.4b8c33d2-0a94-434e-a022-4544abd686f5" returned: 0 in 0.670s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-5a115b0b-5948-4e39-afd4-87e57f98cd97 tempest-VolumesSnapshotTestJSON-1640546916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92191068-9599-438f-a55f-888044213526(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ca75e6-2c36-4b1a-955f-9fd46b75aa60]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5a115b0b-5948-4e39-afd4-87e57f98cd97 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:26 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-69179179-c6aa-45c1-9c46-bba07624d131" returned: 0 in 0.411s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.112s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-194483246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d106bea-32d3-4b32-a54d-5e6e830f17b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85fae6fc5a984195b885113b202c7d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:05:23Z,use_quota=True,user_id='46e1c75cede042baaf0c1704f089e208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Creating volume 8d106bea-32d3-4b32-a54d-5e6e830f17b4 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:05:26 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8d106bea-32d3-4b32-a54d-5e6e830f17b4 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e5324f3-01de-477c-9b9d-8c8679e46174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69179179-c6aa-45c1-9c46-bba07624d131', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:26 devstack sudo[94408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee3cc741-6603-4e57-98c0-c82fecf1f3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:26 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:26 devstack sudo[94410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8d106bea-32d3-4b32-a54d-5e6e830f17b4 1073741824
Sep 07 18:05:26 devstack sudo[94410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:26 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Volume volume-69179179-c6aa-45c1-9c46-bba07624d131 (69179179-c6aa-45c1-9c46-bba07624d131): created successfully
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee3cc741-6603-4e57-98c0-c82fecf1f3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Flow 'volume_create_manager' (dc81fd56-de13-42e9-9b49-0123cb2750bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:05:26 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-984b21f4-4b4f-40a6-9828-02f91c7f6a8c tempest-ServerRescueNegativeTestJSON-372102027 None] Created volume successfully.
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c3e53c4d-94b4-40cf-ab36-348612734619 tempest-SnapshotMetadataTestJSON-816653332 None] Acquiring lock "cinder-ee5bf974-f37f-43d2-b373-c2d22e69da98-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c3e53c4d-94b4-40cf-ab36-348612734619 tempest-SnapshotMetadataTestJSON-816653332 None] Lock "cinder-ee5bf974-f37f-43d2-b373-c2d22e69da98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c3e53c4d-94b4-40cf-ab36-348612734619 tempest-SnapshotMetadataTestJSON-816653332 None] Acquiring lock "cinder-quobyte-f78452ef-55b1-45f8-b3f8-b72c3fdee61f" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c3e53c4d-94b4-40cf-ab36-348612734619 tempest-SnapshotMetadataTestJSON-816653332 None] Lock "cinder-quobyte-f78452ef-55b1-45f8-b3f8-b72c3fdee61f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c3e53c4d-94b4-40cf-ab36-348612734619 tempest-SnapshotMetadataTestJSON-816653332 None] Acquiring lock "cinder-quobyte-ee5bf974-f37f-43d2-b373-c2d22e69da98" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c3e53c4d-94b4-40cf-ab36-348612734619 tempest-SnapshotMetadataTestJSON-816653332 None] Lock "cinder-quobyte-ee5bf974-f37f-43d2-b373-c2d22e69da98" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-c3e53c4d-94b4-40cf-ab36-348612734619 tempest-SnapshotMetadataTestJSON-816653332 None] Deleting offline snapshot ee5bf974-f37f-43d2-b373-c2d22e69da98 of volume f78452ef-55b1-45f8-b3f8-b72c3fdee61f {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-c3e53c4d-94b4-40cf-ab36-348612734619 tempest-SnapshotMetadataTestJSON-816653332 None] snapshot_file for this snap is: volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f.ee5bf974-f37f-43d2-b373-c2d22e69da98 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ac6475-436f-4b03-852b-ead0e5ad75d9]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c3e53c4d-94b4-40cf-ab36-348612734619 tempest-SnapshotMetadataTestJSON-816653332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f.ee5bf974-f37f-43d2-b373-c2d22e69da98 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:26 devstack sudo[94410]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8d106bea-32d3-4b32-a54d-5e6e830f17b4 1073741824" returned: 0 in 0.620s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8d106bea-32d3-4b32-a54d-5e6e830f17b4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:26 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:26 devstack sudo[94419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f.ee5bf974-f37f-43d2-b373-c2d22e69da98
Sep 07 18:05:26 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5a115b0b-5948-4e39-afd4-87e57f98cd97 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526" returned: 0 in 0.788s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5a115b0b-5948-4e39-afd4-87e57f98cd97 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.4b8c33d2-0a94-434e-a022-4544abd686f5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:26 devstack sudo[94423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8d106bea-32d3-4b32-a54d-5e6e830f17b4
Sep 07 18:05:26 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:26 devstack sudo[94424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.4b8c33d2-0a94-434e-a022-4544abd686f5
Sep 07 18:05:26 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:27 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8d106bea-32d3-4b32-a54d-5e6e830f17b4" returned: 0 in 0.368s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:05:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1001f4d3-6633-46f9-9ac6-df9e9a69d77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d106bea-32d3-4b32-a54d-5e6e830f17b4', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2f517b-7ea6-49ae-8d2e-6425f71986a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:27 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Volume volume-8d106bea-32d3-4b32-a54d-5e6e830f17b4 (8d106bea-32d3-4b32-a54d-5e6e830f17b4): created successfully
Sep 07 18:05:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2f517b-7ea6-49ae-8d2e-6425f71986a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Flow 'volume_create_manager' (85f7947b-d5c6-45cd-bfb2-49595e4a10d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:05:27 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-148be159-8be5-4336-834f-eaac145c9d9b tempest-AttachVolumeTestJSON-728677255 None] Created volume successfully.
Sep 07 18:05:27 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c3e53c4d-94b4-40cf-ab36-348612734619 tempest-SnapshotMetadataTestJSON-816653332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f.ee5bf974-f37f-43d2-b373-c2d22e69da98" returned: 0 in 0.636s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-c3e53c4d-94b4-40cf-ab36-348612734619 tempest-SnapshotMetadataTestJSON-816653332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:05:27 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[648995b3-cd52-49cc-8f9f-17ea8da8525c]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:05:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c3e53c4d-94b4-40cf-ab36-348612734619 tempest-SnapshotMetadataTestJSON-816653332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:27 devstack sudo[94435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f
Sep 07 18:05:27 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:27 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5a115b0b-5948-4e39-afd4-87e57f98cd97 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.4b8c33d2-0a94-434e-a022-4544abd686f5" returned: 0 in 0.756s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5a115b0b-5948-4e39-afd4-87e57f98cd97 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.4b8c33d2-0a94-434e-a022-4544abd686f5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:27 devstack sudo[94437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.4b8c33d2-0a94-434e-a022-4544abd686f5
Sep 07 18:05:27 devstack sudo[94437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:27 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c3e53c4d-94b4-40cf-ab36-348612734619 tempest-SnapshotMetadataTestJSON-816653332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f" returned: 0 in 0.495s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c3e53c4d-94b4-40cf-ab36-348612734619 tempest-SnapshotMetadataTestJSON-816653332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f.ee5bf974-f37f-43d2-b373-c2d22e69da98 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:27 devstack sudo[94443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f.ee5bf974-f37f-43d2-b373-c2d22e69da98
Sep 07 18:05:27 devstack sudo[94443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:28 devstack sudo[94437]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5a115b0b-5948-4e39-afd4-87e57f98cd97 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526.4b8c33d2-0a94-434e-a022-4544abd686f5" returned: 0 in 0.368s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5a115b0b-5948-4e39-afd4-87e57f98cd97 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-4b8c33d2-0a94-434e-a022-4544abd686f5" released by "_delete_snapshot" :: held 2.736s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5a115b0b-5948-4e39-afd4-87e57f98cd97 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-92191068-9599-438f-a55f-888044213526" released by "delete_snapshot" :: held 2.777s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:28 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-5a115b0b-5948-4e39-afd4-87e57f98cd97 tempest-VolumesSnapshotTestJSON-1640546916 None] Created reservations ['1257d967-aba9-4008-98ee-f69e8b64052a', '618eaa64-b0ab-4cad-b9bb-ed019f0c2ea2', 'bceeb271-621b-426b-8f53-78de46034d6b', '22ae1a5f-d6c6-485e-a385-cd8430df2f45'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:05:28 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5a115b0b-5948-4e39-afd4-87e57f98cd97 tempest-VolumesSnapshotTestJSON-1640546916 None] Delete snapshot completed successfully.
Sep 07 18:05:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5a115b0b-5948-4e39-afd4-87e57f98cd97 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-4b8c33d2-0a94-434e-a022-4544abd686f5-delete_snapshot" released by "delete_snapshot" :: held 3.019s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:28 devstack sudo[94443]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c3e53c4d-94b4-40cf-ab36-348612734619 tempest-SnapshotMetadataTestJSON-816653332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f.ee5bf974-f37f-43d2-b373-c2d22e69da98" returned: 0 in 0.470s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c3e53c4d-94b4-40cf-ab36-348612734619 tempest-SnapshotMetadataTestJSON-816653332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f.ee5bf974-f37f-43d2-b373-c2d22e69da98 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:28 devstack sudo[94451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f.ee5bf974-f37f-43d2-b373-c2d22e69da98
Sep 07 18:05:28 devstack sudo[94451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c4019cc1-49a0-4c1b-a65c-23cedb9c8fc3 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "cinder-92191068-9599-438f-a55f-888044213526-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c4019cc1-49a0-4c1b-a65c-23cedb9c8fc3 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-92191068-9599-438f-a55f-888044213526-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:28 devstack sudo[94451]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c4019cc1-49a0-4c1b-a65c-23cedb9c8fc3 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "cinder-quobyte-92191068-9599-438f-a55f-888044213526" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c3e53c4d-94b4-40cf-ab36-348612734619 tempest-SnapshotMetadataTestJSON-816653332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f.ee5bf974-f37f-43d2-b373-c2d22e69da98" returned: 0 in 0.565s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c4019cc1-49a0-4c1b-a65c-23cedb9c8fc3 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-92191068-9599-438f-a55f-888044213526" acquired by "delete_volume" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:29 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9781c7fa-fd43-4c74-8f4d-8f5fd9b1e220]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:05:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c4019cc1-49a0-4c1b-a65c-23cedb9c8fc3 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c3e53c4d-94b4-40cf-ab36-348612734619 tempest-SnapshotMetadataTestJSON-816653332 None] Lock "cinder-quobyte-ee5bf974-f37f-43d2-b373-c2d22e69da98" released by "_delete_snapshot" :: held 2.424s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c3e53c4d-94b4-40cf-ab36-348612734619 tempest-SnapshotMetadataTestJSON-816653332 None] Lock "cinder-quobyte-f78452ef-55b1-45f8-b3f8-b72c3fdee61f" released by "delete_snapshot" :: held 2.465s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:29 devstack sudo[94470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526
Sep 07 18:05:29 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:29 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-c3e53c4d-94b4-40cf-ab36-348612734619 tempest-SnapshotMetadataTestJSON-816653332 None] Created reservations ['0b26df2c-cdfa-49b3-b14a-c0048d482496', '459155a6-8134-4707-82e2-05502d86ed55', '46046b6d-b49e-41ae-bc83-5a9a4aeab427', 'f93d7b5b-b25f-4eff-8153-549570dfd9d2'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:05:29 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-c3e53c4d-94b4-40cf-ab36-348612734619 tempest-SnapshotMetadataTestJSON-816653332 None] Delete snapshot completed successfully.
Sep 07 18:05:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c3e53c4d-94b4-40cf-ab36-348612734619 tempest-SnapshotMetadataTestJSON-816653332 None] Lock "cinder-ee5bf974-f37f-43d2-b373-c2d22e69da98-delete_snapshot" released by "delete_snapshot" :: held 2.820s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:29 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c4019cc1-49a0-4c1b-a65c-23cedb9c8fc3 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526" returned: 0 in 0.512s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c4019cc1-49a0-4c1b-a65c-23cedb9c8fc3 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:29 devstack sudo[94486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526
Sep 07 18:05:29 devstack sudo[94486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-e2065125-a79c-45e7-96c7-e76b111a76e3 req-b3c0310d-71c0-435b-b60b-67f943172edd tempest-AttachVolumeTestJSON-728677255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-e2065125-a79c-45e7-96c7-e76b111a76e3 req-b3c0310d-71c0-435b-b60b-67f943172edd tempest-AttachVolumeTestJSON-728677255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-e2065125-a79c-45e7-96c7-e76b111a76e3 req-b3c0310d-71c0-435b-b60b-67f943172edd tempest-AttachVolumeTestJSON-728677255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-e2065125-a79c-45e7-96c7-e76b111a76e3 req-b3c0310d-71c0-435b-b60b-67f943172edd tempest-AttachVolumeTestJSON-728677255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d', 'name': 'volume-8d106bea-32d3-4b32-a54d-5e6e830f17b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb58e369-6bfc-4196-b1c5-110223ad4bda', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 07 18:05:29 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-e2065125-a79c-45e7-96c7-e76b111a76e3 req-b3c0310d-71c0-435b-b60b-67f943172edd tempest-AttachVolumeTestJSON-728677255 None] attachment_update completed successfully.
Sep 07 18:05:29 devstack sudo[94486]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c4019cc1-49a0-4c1b-a65c-23cedb9c8fc3 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-92191068-9599-438f-a55f-888044213526" returned: 0 in 0.333s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c4019cc1-49a0-4c1b-a65c-23cedb9c8fc3 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-92191068-9599-438f-a55f-888044213526" released by "delete_volume" :: held 1.023s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:30 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-c4019cc1-49a0-4c1b-a65c-23cedb9c8fc3 tempest-VolumesSnapshotTestJSON-1640546916 None] Created reservations ['918ec87d-df3b-4e7b-a13c-65cf37b277a5', '32f2e59e-6a21-4bef-9b78-307e67dac7f3', 'b1d77401-dc26-45e9-8145-db9a21bc07a0', '4a524102-bf1e-4842-81ba-cf6616261259'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:05:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d84be668-0d35-4831-b23a-d917f37fa708 tempest-SnapshotMetadataTestJSON-816653332 None] Acquiring lock "cinder-f78452ef-55b1-45f8-b3f8-b72c3fdee61f-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d84be668-0d35-4831-b23a-d917f37fa708 tempest-SnapshotMetadataTestJSON-816653332 None] Lock "cinder-f78452ef-55b1-45f8-b3f8-b72c3fdee61f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c4019cc1-49a0-4c1b-a65c-23cedb9c8fc3 tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c4019cc1-49a0-4c1b-a65c-23cedb9c8fc3 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c4019cc1-49a0-4c1b-a65c-23cedb9c8fc3 tempest-VolumesSnapshotTestJSON-1640546916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:05:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c4019cc1-49a0-4c1b-a65c-23cedb9c8fc3 tempest-VolumesSnapshotTestJSON-1640546916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:05:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c4019cc1-49a0-4c1b-a65c-23cedb9c8fc3 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c4019cc1-49a0-4c1b-a65c-23cedb9c8fc3 tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:30 devstack sudo[94890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:05:30 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d84be668-0d35-4831-b23a-d917f37fa708 tempest-SnapshotMetadataTestJSON-816653332 None] Acquiring lock "cinder-quobyte-f78452ef-55b1-45f8-b3f8-b72c3fdee61f" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d84be668-0d35-4831-b23a-d917f37fa708 tempest-SnapshotMetadataTestJSON-816653332 None] Lock "cinder-quobyte-f78452ef-55b1-45f8-b3f8-b72c3fdee61f" acquired by "delete_volume" :: waited 0.036s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:30 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c54c642-609e-4024-8d0d-19b0a7be4def]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:05:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d84be668-0d35-4831-b23a-d917f37fa708 tempest-SnapshotMetadataTestJSON-816653332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:30 devstack sudo[94894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f
Sep 07 18:05:30 devstack sudo[94894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:30 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c4019cc1-49a0-4c1b-a65c-23cedb9c8fc3 tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.512s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:30 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-c4019cc1-49a0-4c1b-a65c-23cedb9c8fc3 tempest-VolumesSnapshotTestJSON-1640546916 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:05:30 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-c4019cc1-49a0-4c1b-a65c-23cedb9c8fc3 tempest-VolumesSnapshotTestJSON-1640546916 None] Deleted volume successfully.
Sep 07 18:05:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c4019cc1-49a0-4c1b-a65c-23cedb9c8fc3 tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-92191068-9599-438f-a55f-888044213526-delete_volume" released by "delete_volume" :: held 2.066s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:31 devstack sudo[94894]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d84be668-0d35-4831-b23a-d917f37fa708 tempest-SnapshotMetadataTestJSON-816653332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f" returned: 0 in 0.697s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d84be668-0d35-4831-b23a-d917f37fa708 tempest-SnapshotMetadataTestJSON-816653332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:31 devstack sudo[94936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f
Sep 07 18:05:31 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ce419855-8d8d-4ad5-9020-522788a2b50b tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "cinder-3f1bc092-ac4d-41b7-a219-65fb23d3b19d-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ce419855-8d8d-4ad5-9020-522788a2b50b tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-3f1bc092-ac4d-41b7-a219-65fb23d3b19d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ce419855-8d8d-4ad5-9020-522788a2b50b tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "cinder-quobyte-3f1bc092-ac4d-41b7-a219-65fb23d3b19d" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ce419855-8d8d-4ad5-9020-522788a2b50b tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-3f1bc092-ac4d-41b7-a219-65fb23d3b19d" acquired by "delete_volume" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:31 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9118866f-a174-43d5-856d-7a176d3a5f6a]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:05:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ce419855-8d8d-4ad5-9020-522788a2b50b tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:31 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d84be668-0d35-4831-b23a-d917f37fa708 tempest-SnapshotMetadataTestJSON-816653332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f78452ef-55b1-45f8-b3f8-b72c3fdee61f" returned: 0 in 0.375s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d84be668-0d35-4831-b23a-d917f37fa708 tempest-SnapshotMetadataTestJSON-816653332 None] Lock "cinder-quobyte-f78452ef-55b1-45f8-b3f8-b72c3fdee61f" released by "delete_volume" :: held 1.190s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:31 devstack sudo[94940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d
Sep 07 18:05:31 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:31 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-d84be668-0d35-4831-b23a-d917f37fa708 tempest-SnapshotMetadataTestJSON-816653332 None] Created reservations ['572702d7-1a7a-4ac3-b6ec-4c5d01686ea6', 'aff89c91-ef87-464c-8fd5-d4f3ebe4b8fe', 'dc9ca1bf-4874-4824-9e59-fd47569154a2', '19a7a030-0852-40bd-a6ea-416656b1756a'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:05:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d84be668-0d35-4831-b23a-d917f37fa708 tempest-SnapshotMetadataTestJSON-816653332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d84be668-0d35-4831-b23a-d917f37fa708 tempest-SnapshotMetadataTestJSON-816653332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d84be668-0d35-4831-b23a-d917f37fa708 tempest-SnapshotMetadataTestJSON-816653332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:05:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d84be668-0d35-4831-b23a-d917f37fa708 tempest-SnapshotMetadataTestJSON-816653332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:05:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d84be668-0d35-4831-b23a-d917f37fa708 tempest-SnapshotMetadataTestJSON-816653332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d84be668-0d35-4831-b23a-d917f37fa708 tempest-SnapshotMetadataTestJSON-816653332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:31 devstack sudo[94942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:05:31 devstack sudo[94942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:31 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ce419855-8d8d-4ad5-9020-522788a2b50b tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d" returned: 0 in 0.460s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ce419855-8d8d-4ad5-9020-522788a2b50b tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:31 devstack sudo[94947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d
Sep 07 18:05:31 devstack sudo[94947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:32 devstack sudo[94942]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d84be668-0d35-4831-b23a-d917f37fa708 tempest-SnapshotMetadataTestJSON-816653332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.356s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:32 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-d84be668-0d35-4831-b23a-d917f37fa708 tempest-SnapshotMetadataTestJSON-816653332 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:05:32 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d84be668-0d35-4831-b23a-d917f37fa708 tempest-SnapshotMetadataTestJSON-816653332 None] Deleted volume successfully.
Sep 07 18:05:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d84be668-0d35-4831-b23a-d917f37fa708 tempest-SnapshotMetadataTestJSON-816653332 None] Lock "cinder-f78452ef-55b1-45f8-b3f8-b72c3fdee61f-delete_volume" released by "delete_volume" :: held 1.954s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:32 devstack sudo[94947]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ce419855-8d8d-4ad5-9020-522788a2b50b tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3f1bc092-ac4d-41b7-a219-65fb23d3b19d" returned: 0 in 0.355s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ce419855-8d8d-4ad5-9020-522788a2b50b tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-quobyte-3f1bc092-ac4d-41b7-a219-65fb23d3b19d" released by "delete_volume" :: held 0.921s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:32 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-ce419855-8d8d-4ad5-9020-522788a2b50b tempest-VolumesSnapshotTestJSON-1640546916 None] Created reservations ['0f5187a8-c1fc-4af1-88eb-bfaa17b84af8', 'a4419d43-9525-4515-b8db-582c0f360530', 'dfd8ccd4-d72a-4c23-8ad1-5eb49bda5b78', '95ef64a9-1452-4de5-b686-d5957bacf1ec'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:05:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ce419855-8d8d-4ad5-9020-522788a2b50b tempest-VolumesSnapshotTestJSON-1640546916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ce419855-8d8d-4ad5-9020-522788a2b50b tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ce419855-8d8d-4ad5-9020-522788a2b50b tempest-VolumesSnapshotTestJSON-1640546916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:05:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ce419855-8d8d-4ad5-9020-522788a2b50b tempest-VolumesSnapshotTestJSON-1640546916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:05:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ce419855-8d8d-4ad5-9020-522788a2b50b tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ce419855-8d8d-4ad5-9020-522788a2b50b tempest-VolumesSnapshotTestJSON-1640546916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:32 devstack sudo[94951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:05:32 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:33 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ce419855-8d8d-4ad5-9020-522788a2b50b tempest-VolumesSnapshotTestJSON-1640546916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.486s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:33 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-ce419855-8d8d-4ad5-9020-522788a2b50b tempest-VolumesSnapshotTestJSON-1640546916 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:05:33 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ce419855-8d8d-4ad5-9020-522788a2b50b tempest-VolumesSnapshotTestJSON-1640546916 None] Deleted volume successfully.
Sep 07 18:05:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ce419855-8d8d-4ad5-9020-522788a2b50b tempest-VolumesSnapshotTestJSON-1640546916 None] Lock "cinder-3f1bc092-ac4d-41b7-a219-65fb23d3b19d-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:33 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:05:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Flow 'volume_create_manager' (50c60073-29de-4d46-80f0-cd13fcba2b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:05:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1194273c-8ef9-439e-af09-f1edf1350a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1194273c-8ef9-439e-af09-f1edf1350a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-157521329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07796114-3da2-4146-b947-6ba434187c7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85fae6fc5a984195b885113b202c7d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:05:33Z,use_quota=True,user_id='46e1c75cede042baaf0c1704f089e208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba871c8-643d-4392-ac80-392de438dd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba871c8-643d-4392-ac80-392de438dd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ce5800-d895-4220-bb59-0b68e853c773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ce5800-d895-4220-bb59-0b68e853c773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07796114-3da2-4146-b947-6ba434187c7b', 'volume_name': 'volume-07796114-3da2-4146-b947-6ba434187c7b', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5be0163-0f55-4105-b738-e65ff3af9ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5be0163-0f55-4105-b738-e65ff3af9ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2cf92cf-6a72-4f8d-aa5c-12c0fdbc106a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:33 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Volume 07796114-3da2-4146-b947-6ba434187c7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07796114-3da2-4146-b947-6ba434187c7b', 'volume_size': 1}
Sep 07 18:05:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-157521329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07796114-3da2-4146-b947-6ba434187c7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='85fae6fc5a984195b885113b202c7d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:05:33Z,use_quota=True,user_id='46e1c75cede042baaf0c1704f089e208',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:05:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Creating volume 07796114-3da2-4146-b947-6ba434187c7b {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:05:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:05:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:05:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:05:33 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:05:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-07796114-3da2-4146-b947-6ba434187c7b 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:33 devstack sudo[94955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-07796114-3da2-4146-b947-6ba434187c7b 1073741824
Sep 07 18:05:33 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:33 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-07796114-3da2-4146-b947-6ba434187c7b 1073741824" returned: 0 in 0.580s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-07796114-3da2-4146-b947-6ba434187c7b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:34 devstack sudo[94965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-07796114-3da2-4146-b947-6ba434187c7b
Sep 07 18:05:34 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:34 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-07796114-3da2-4146-b947-6ba434187c7b" returned: 0 in 0.399s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:05:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2cf92cf-6a72-4f8d-aa5c-12c0fdbc106a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07796114-3da2-4146-b947-6ba434187c7b', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2001e683-d066-4065-b556-2d31f5e1ef6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:34 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Volume volume-07796114-3da2-4146-b947-6ba434187c7b (07796114-3da2-4146-b947-6ba434187c7b): created successfully
Sep 07 18:05:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2001e683-d066-4065-b556-2d31f5e1ef6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Flow 'volume_create_manager' (50c60073-29de-4d46-80f0-cd13fcba2b81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:05:34 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-532e32ed-5eb0-4674-ac71-02953d210843 tempest-AttachVolumeTestJSON-728677255 None] Created volume successfully.
Sep 07 18:05:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-f6cbfbc0-71f4-4c6b-87ef-98155340c081 req-a7bef745-9ddd-4fe0-9d0c-f5660b1a1610 tempest-AttachVolumeTestJSON-728677255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-f6cbfbc0-71f4-4c6b-87ef-98155340c081 req-a7bef745-9ddd-4fe0-9d0c-f5660b1a1610 tempest-AttachVolumeTestJSON-728677255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-f6cbfbc0-71f4-4c6b-87ef-98155340c081 req-a7bef745-9ddd-4fe0-9d0c-f5660b1a1610 tempest-AttachVolumeTestJSON-728677255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d9bf69c9-f834-436f-8636-c604297e83bc tempest-ServerRescueNegativeTestJSON-372102027 None] Acquiring lock "cinder-69179179-c6aa-45c1-9c46-bba07624d131-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d9bf69c9-f834-436f-8636-c604297e83bc tempest-ServerRescueNegativeTestJSON-372102027 None] Lock "cinder-69179179-c6aa-45c1-9c46-bba07624d131-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-f6cbfbc0-71f4-4c6b-87ef-98155340c081 req-a7bef745-9ddd-4fe0-9d0c-f5660b1a1610 tempest-AttachVolumeTestJSON-728677255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d', 'name': 'volume-07796114-3da2-4146-b947-6ba434187c7b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64fe9b8d-3a8e-456b-8790-b9d96d39e67f', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 07 18:05:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d9bf69c9-f834-436f-8636-c604297e83bc tempest-ServerRescueNegativeTestJSON-372102027 None] Acquiring lock "cinder-quobyte-69179179-c6aa-45c1-9c46-bba07624d131" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d9bf69c9-f834-436f-8636-c604297e83bc tempest-ServerRescueNegativeTestJSON-372102027 None] Lock "cinder-quobyte-69179179-c6aa-45c1-9c46-bba07624d131" acquired by "delete_volume" :: waited 0.043s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:37 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-f6cbfbc0-71f4-4c6b-87ef-98155340c081 req-a7bef745-9ddd-4fe0-9d0c-f5660b1a1610 tempest-AttachVolumeTestJSON-728677255 None] attachment_update completed successfully.
Sep 07 18:05:37 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1c00a1-c98b-4794-948f-e46656f0fcad]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:05:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d9bf69c9-f834-436f-8636-c604297e83bc tempest-ServerRescueNegativeTestJSON-372102027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-69179179-c6aa-45c1-9c46-bba07624d131 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:37 devstack sudo[95009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-69179179-c6aa-45c1-9c46-bba07624d131
Sep 07 18:05:37 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:37 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d9bf69c9-f834-436f-8636-c604297e83bc tempest-ServerRescueNegativeTestJSON-372102027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-69179179-c6aa-45c1-9c46-bba07624d131" returned: 0 in 0.681s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d9bf69c9-f834-436f-8636-c604297e83bc tempest-ServerRescueNegativeTestJSON-372102027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-69179179-c6aa-45c1-9c46-bba07624d131 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:37 devstack sudo[95018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-69179179-c6aa-45c1-9c46-bba07624d131
Sep 07 18:05:37 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:38 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d9bf69c9-f834-436f-8636-c604297e83bc tempest-ServerRescueNegativeTestJSON-372102027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-69179179-c6aa-45c1-9c46-bba07624d131" returned: 0 in 0.327s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d9bf69c9-f834-436f-8636-c604297e83bc tempest-ServerRescueNegativeTestJSON-372102027 None] Lock "cinder-quobyte-69179179-c6aa-45c1-9c46-bba07624d131" released by "delete_volume" :: held 1.081s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:38 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-d9bf69c9-f834-436f-8636-c604297e83bc tempest-ServerRescueNegativeTestJSON-372102027 None] Created reservations ['3add8692-f9f6-4e08-9bc2-6ffbe0d7aad0', '56250fbd-dd0e-49af-89aa-1f73565cbdf9', '9477ee95-c0a3-47ba-9a48-f06a1d358f8a', '38c7b2d4-ab34-4843-b530-910517a1328c'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:05:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d9bf69c9-f834-436f-8636-c604297e83bc tempest-ServerRescueNegativeTestJSON-372102027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d9bf69c9-f834-436f-8636-c604297e83bc tempest-ServerRescueNegativeTestJSON-372102027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d9bf69c9-f834-436f-8636-c604297e83bc tempest-ServerRescueNegativeTestJSON-372102027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:05:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d9bf69c9-f834-436f-8636-c604297e83bc tempest-ServerRescueNegativeTestJSON-372102027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:05:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d9bf69c9-f834-436f-8636-c604297e83bc tempest-ServerRescueNegativeTestJSON-372102027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d9bf69c9-f834-436f-8636-c604297e83bc tempest-ServerRescueNegativeTestJSON-372102027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:38 devstack sudo[95023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:05:38 devstack sudo[95023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:39 devstack sudo[95023]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d9bf69c9-f834-436f-8636-c604297e83bc tempest-ServerRescueNegativeTestJSON-372102027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.709s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:39 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-d9bf69c9-f834-436f-8636-c604297e83bc tempest-ServerRescueNegativeTestJSON-372102027 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:05:39 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d9bf69c9-f834-436f-8636-c604297e83bc tempest-ServerRescueNegativeTestJSON-372102027 None] Deleted volume successfully.
Sep 07 18:05:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d9bf69c9-f834-436f-8636-c604297e83bc tempest-ServerRescueNegativeTestJSON-372102027 None] Lock "cinder-69179179-c6aa-45c1-9c46-bba07624d131-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:40 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-7adc8cf5-858f-4d4c-aec6-c6b6ade40682 req-c08c155e-2a55-493d-b7a5-ee8b1e733582 tempest-AttachVolumeTestJSON-728677255 None] Terminate volume connection completed successfully.
Sep 07 18:05:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-7adc8cf5-858f-4d4c-aec6-c6b6ade40682 req-c08c155e-2a55-493d-b7a5-ee8b1e733582 tempest-AttachVolumeTestJSON-728677255 None] Deleting attachment eb58e369-6bfc-4196-b1c5-110223ad4bda. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 07 18:05:41 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:05:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Flow 'volume_create_manager' (56ce427b-1d25-44b7-b176-06b8f6934134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:05:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f232403-a6af-4ffb-9144-6d1e17cbd591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f232403-a6af-4ffb-9144-6d1e17cbd591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2062403238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c979ea38-db85-481d-b0cb-51227fdc6a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d236eeb507c4d3088c3a8dd6f5891b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:05:42Z,use_quota=True,user_id='303b2abf3928466cb0d840e596fdce19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971f9af1-df54-4f39-b991-0ebf38811e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971f9af1-df54-4f39-b991-0ebf38811e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38702914-bbd3-4041-8dfd-d2fdd2b80193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38702914-bbd3-4041-8dfd-d2fdd2b80193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c979ea38-db85-481d-b0cb-51227fdc6a89', 'volume_name': 'volume-c979ea38-db85-481d-b0cb-51227fdc6a89', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff23372-997c-4fad-8824-b469193ca7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fff23372-997c-4fad-8824-b469193ca7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400b1c6b-4480-4331-ad75-135f1d981614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:42 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Volume c979ea38-db85-481d-b0cb-51227fdc6a89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c979ea38-db85-481d-b0cb-51227fdc6a89', 'volume_size': 1}
Sep 07 18:05:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2062403238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c979ea38-db85-481d-b0cb-51227fdc6a89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d236eeb507c4d3088c3a8dd6f5891b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:05:42Z,use_quota=True,user_id='303b2abf3928466cb0d840e596fdce19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:05:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Creating volume c979ea38-db85-481d-b0cb-51227fdc6a89 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:05:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:05:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:05:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:05:42 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:05:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c979ea38-db85-481d-b0cb-51227fdc6a89 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:42 devstack sudo[95078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c979ea38-db85-481d-b0cb-51227fdc6a89 1073741824
Sep 07 18:05:42 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:43 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c979ea38-db85-481d-b0cb-51227fdc6a89 1073741824" returned: 0 in 0.941s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:43 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-f7efa44c-c211-4b42-bcb2-42fe598446e3 req-eadea851-8fbb-4174-bbf7-da81b1d859a8 tempest-AttachVolumeTestJSON-728677255 None] Terminate volume connection completed successfully.
Sep 07 18:05:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-f7efa44c-c211-4b42-bcb2-42fe598446e3 req-eadea851-8fbb-4174-bbf7-da81b1d859a8 tempest-AttachVolumeTestJSON-728677255 None] Deleting attachment 64fe9b8d-3a8e-456b-8790-b9d96d39e67f. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 07 18:05:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c979ea38-db85-481d-b0cb-51227fdc6a89 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:43 devstack sudo[95112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c979ea38-db85-481d-b0cb-51227fdc6a89
Sep 07 18:05:43 devstack sudo[95112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:43 devstack sudo[95112]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c979ea38-db85-481d-b0cb-51227fdc6a89" returned: 0 in 0.297s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:05:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400b1c6b-4480-4331-ad75-135f1d981614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c979ea38-db85-481d-b0cb-51227fdc6a89', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b60b79c-a48f-4314-9a58-10c5ed334c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:43 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Volume volume-c979ea38-db85-481d-b0cb-51227fdc6a89 (c979ea38-db85-481d-b0cb-51227fdc6a89): created successfully
Sep 07 18:05:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b60b79c-a48f-4314-9a58-10c5ed334c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Flow 'volume_create_manager' (56ce427b-1d25-44b7-b176-06b8f6934134) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:05:43 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f70f8a4b-b68e-4e70-a479-3f33ae5b488a tempest-AbsoluteLimitsTests-1696568199 None] Created volume successfully.
Sep 07 18:05:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0fc44ed0-aa94-4849-a5fd-0d615fb47ba3 tempest-AbsoluteLimitsTests-1696568199 None] Acquiring lock "cinder-c979ea38-db85-481d-b0cb-51227fdc6a89-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0fc44ed0-aa94-4849-a5fd-0d615fb47ba3 tempest-AbsoluteLimitsTests-1696568199 None] Lock "cinder-c979ea38-db85-481d-b0cb-51227fdc6a89-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0fc44ed0-aa94-4849-a5fd-0d615fb47ba3 tempest-AbsoluteLimitsTests-1696568199 None] Acquiring lock "cinder-quobyte-c979ea38-db85-481d-b0cb-51227fdc6a89" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0fc44ed0-aa94-4849-a5fd-0d615fb47ba3 tempest-AbsoluteLimitsTests-1696568199 None] Lock "cinder-quobyte-c979ea38-db85-481d-b0cb-51227fdc6a89" acquired by "delete_volume" :: waited 0.032s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:44 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbc340b-2996-4d45-ad58-891a8a7b8188]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:05:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0fc44ed0-aa94-4849-a5fd-0d615fb47ba3 tempest-AbsoluteLimitsTests-1696568199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c979ea38-db85-481d-b0cb-51227fdc6a89 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:44 devstack sudo[95117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c979ea38-db85-481d-b0cb-51227fdc6a89
Sep 07 18:05:44 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0fc44ed0-aa94-4849-a5fd-0d615fb47ba3 tempest-AbsoluteLimitsTests-1696568199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c979ea38-db85-481d-b0cb-51227fdc6a89" returned: 0 in 0.727s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:45 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0fc44ed0-aa94-4849-a5fd-0d615fb47ba3 tempest-AbsoluteLimitsTests-1696568199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c979ea38-db85-481d-b0cb-51227fdc6a89 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:45 devstack sudo[95138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c979ea38-db85-481d-b0cb-51227fdc6a89
Sep 07 18:05:45 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:45 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0fc44ed0-aa94-4849-a5fd-0d615fb47ba3 tempest-AbsoluteLimitsTests-1696568199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c979ea38-db85-481d-b0cb-51227fdc6a89" returned: 0 in 0.416s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0fc44ed0-aa94-4849-a5fd-0d615fb47ba3 tempest-AbsoluteLimitsTests-1696568199 None] Lock "cinder-quobyte-c979ea38-db85-481d-b0cb-51227fdc6a89" released by "delete_volume" :: held 1.268s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:45 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-0fc44ed0-aa94-4849-a5fd-0d615fb47ba3 tempest-AbsoluteLimitsTests-1696568199 None] Created reservations ['36da7e08-7dfd-4c00-9690-5c49e0528951', '6e9672c6-bc5c-4c8f-b953-137a032e8aa3', '091fbac7-53a2-49b6-bc65-04d382108fa1', '6a7dc19c-0ab0-40aa-a009-1ed7cbefd127'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:05:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0fc44ed0-aa94-4849-a5fd-0d615fb47ba3 tempest-AbsoluteLimitsTests-1696568199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0fc44ed0-aa94-4849-a5fd-0d615fb47ba3 tempest-AbsoluteLimitsTests-1696568199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0fc44ed0-aa94-4849-a5fd-0d615fb47ba3 tempest-AbsoluteLimitsTests-1696568199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:05:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0fc44ed0-aa94-4849-a5fd-0d615fb47ba3 tempest-AbsoluteLimitsTests-1696568199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:05:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0fc44ed0-aa94-4849-a5fd-0d615fb47ba3 tempest-AbsoluteLimitsTests-1696568199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0fc44ed0-aa94-4849-a5fd-0d615fb47ba3 tempest-AbsoluteLimitsTests-1696568199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:46 devstack sudo[95164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:05:46 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:46 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0fc44ed0-aa94-4849-a5fd-0d615fb47ba3 tempest-AbsoluteLimitsTests-1696568199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.300s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:46 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-0fc44ed0-aa94-4849-a5fd-0d615fb47ba3 tempest-AbsoluteLimitsTests-1696568199 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:05:46 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0fc44ed0-aa94-4849-a5fd-0d615fb47ba3 tempest-AbsoluteLimitsTests-1696568199 None] Deleted volume successfully.
Sep 07 18:05:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0fc44ed0-aa94-4849-a5fd-0d615fb47ba3 tempest-AbsoluteLimitsTests-1696568199 None] Lock "cinder-c979ea38-db85-481d-b0cb-51227fdc6a89-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2001f0f5-f350-4793-a4b0-b83e706205c0 tempest-AttachVolumeTestJSON-728677255 None] Acquiring lock "cinder-07796114-3da2-4146-b947-6ba434187c7b-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2001f0f5-f350-4793-a4b0-b83e706205c0 tempest-AttachVolumeTestJSON-728677255 None] Lock "cinder-07796114-3da2-4146-b947-6ba434187c7b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2001f0f5-f350-4793-a4b0-b83e706205c0 tempest-AttachVolumeTestJSON-728677255 None] Acquiring lock "cinder-quobyte-07796114-3da2-4146-b947-6ba434187c7b" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2001f0f5-f350-4793-a4b0-b83e706205c0 tempest-AttachVolumeTestJSON-728677255 None] Lock "cinder-quobyte-07796114-3da2-4146-b947-6ba434187c7b" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:53 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec55c90-c4ea-434e-94e6-087010f87f0c]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:05:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2001f0f5-f350-4793-a4b0-b83e706205c0 tempest-AttachVolumeTestJSON-728677255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-07796114-3da2-4146-b947-6ba434187c7b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:54 devstack sudo[95172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-07796114-3da2-4146-b947-6ba434187c7b
Sep 07 18:05:54 devstack sudo[95172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:54 devstack sudo[95172]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2001f0f5-f350-4793-a4b0-b83e706205c0 tempest-AttachVolumeTestJSON-728677255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-07796114-3da2-4146-b947-6ba434187c7b" returned: 0 in 0.574s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2001f0f5-f350-4793-a4b0-b83e706205c0 tempest-AttachVolumeTestJSON-728677255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-07796114-3da2-4146-b947-6ba434187c7b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:54 devstack sudo[95177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-07796114-3da2-4146-b947-6ba434187c7b
Sep 07 18:05:54 devstack sudo[95177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:54 devstack sudo[95177]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2001f0f5-f350-4793-a4b0-b83e706205c0 tempest-AttachVolumeTestJSON-728677255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-07796114-3da2-4146-b947-6ba434187c7b" returned: 0 in 0.390s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2001f0f5-f350-4793-a4b0-b83e706205c0 tempest-AttachVolumeTestJSON-728677255 None] Lock "cinder-quobyte-07796114-3da2-4146-b947-6ba434187c7b" released by "delete_volume" :: held 1.031s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-2001f0f5-f350-4793-a4b0-b83e706205c0 tempest-AttachVolumeTestJSON-728677255 None] Created reservations ['e59ccf27-9fb2-409e-b6e8-79df21c92448', '833333ad-1e1e-4f1f-83b6-660cab5d5acf', '08093c75-e350-4f1a-96b1-e8c019034636', 'ea041af9-402f-4839-a8d8-c3effcf7ac6a'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2001f0f5-f350-4793-a4b0-b83e706205c0 tempest-AttachVolumeTestJSON-728677255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2001f0f5-f350-4793-a4b0-b83e706205c0 tempest-AttachVolumeTestJSON-728677255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2001f0f5-f350-4793-a4b0-b83e706205c0 tempest-AttachVolumeTestJSON-728677255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2001f0f5-f350-4793-a4b0-b83e706205c0 tempest-AttachVolumeTestJSON-728677255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2001f0f5-f350-4793-a4b0-b83e706205c0 tempest-AttachVolumeTestJSON-728677255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2001f0f5-f350-4793-a4b0-b83e706205c0 tempest-AttachVolumeTestJSON-728677255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:55 devstack sudo[95181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:05:55 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Flow 'volume_create_manager' (2e1bf4f9-044e-44bb-add1-e955710e6b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6419aa4-a95e-4076-9dbf-79031e942054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6419aa4-a95e-4076-9dbf-79031e942054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1314344003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7662194e-cafb-4d0c-828c-01dcee522ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834f3beb9aa943488a0cd6de07375309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:05:55Z,use_quota=True,user_id='94729f6ee52b473ab31087977fa906eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9188784-3ca8-4539-ba53-74903e72c82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9188784-3ca8-4539-ba53-74903e72c82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15712916-34c9-4917-9b2f-8600ad952c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15712916-34c9-4917-9b2f-8600ad952c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7662194e-cafb-4d0c-828c-01dcee522ac4', 'volume_name': 'volume-7662194e-cafb-4d0c-828c-01dcee522ac4', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96e7b87-fef0-4967-add8-c583eef6cf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a96e7b87-fef0-4967-add8-c583eef6cf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a89108a4-e23f-4e3c-a079-78b6919c7486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:55 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Volume 7662194e-cafb-4d0c-828c-01dcee522ac4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7662194e-cafb-4d0c-828c-01dcee522ac4', 'volume_size': 1}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1314344003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7662194e-cafb-4d0c-828c-01dcee522ac4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834f3beb9aa943488a0cd6de07375309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:05:55Z,use_quota=True,user_id='94729f6ee52b473ab31087977fa906eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Creating volume 7662194e-cafb-4d0c-828c-01dcee522ac4 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:05:55 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7662194e-cafb-4d0c-828c-01dcee522ac4 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:55 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:55 devstack sudo[95184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7662194e-cafb-4d0c-828c-01dcee522ac4 1073741824
Sep 07 18:05:55 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2001f0f5-f350-4793-a4b0-b83e706205c0 tempest-AttachVolumeTestJSON-728677255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.446s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-2001f0f5-f350-4793-a4b0-b83e706205c0 tempest-AttachVolumeTestJSON-728677255 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:05:55 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2001f0f5-f350-4793-a4b0-b83e706205c0 tempest-AttachVolumeTestJSON-728677255 None] Deleted volume successfully.
Sep 07 18:05:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2001f0f5-f350-4793-a4b0-b83e706205c0 tempest-AttachVolumeTestJSON-728677255 None] Lock "cinder-07796114-3da2-4146-b947-6ba434187c7b-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-aaf4b86e-74b4-4bef-8276-2ab4fbefb394 tempest-AttachVolumeTestJSON-728677255 None] Acquiring lock "cinder-8d106bea-32d3-4b32-a54d-5e6e830f17b4-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-aaf4b86e-74b4-4bef-8276-2ab4fbefb394 tempest-AttachVolumeTestJSON-728677255 None] Lock "cinder-8d106bea-32d3-4b32-a54d-5e6e830f17b4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:56 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7662194e-cafb-4d0c-828c-01dcee522ac4 1073741824" returned: 0 in 0.642s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-aaf4b86e-74b4-4bef-8276-2ab4fbefb394 tempest-AttachVolumeTestJSON-728677255 None] Acquiring lock "cinder-quobyte-8d106bea-32d3-4b32-a54d-5e6e830f17b4" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-aaf4b86e-74b4-4bef-8276-2ab4fbefb394 tempest-AttachVolumeTestJSON-728677255 None] Lock "cinder-quobyte-8d106bea-32d3-4b32-a54d-5e6e830f17b4" acquired by "delete_volume" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7662194e-cafb-4d0c-828c-01dcee522ac4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:56 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b097ab-c50e-43d7-abdd-affa8768bd39]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:05:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aaf4b86e-74b4-4bef-8276-2ab4fbefb394 tempest-AttachVolumeTestJSON-728677255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8d106bea-32d3-4b32-a54d-5e6e830f17b4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:56 devstack sudo[95191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7662194e-cafb-4d0c-828c-01dcee522ac4
Sep 07 18:05:56 devstack sudo[95191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:56 devstack sudo[95192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8d106bea-32d3-4b32-a54d-5e6e830f17b4
Sep 07 18:05:56 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:56 devstack sudo[95191]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7662194e-cafb-4d0c-828c-01dcee522ac4" returned: 0 in 0.358s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:05:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a89108a4-e23f-4e3c-a079-78b6919c7486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7662194e-cafb-4d0c-828c-01dcee522ac4', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d073db1-8906-43c9-b179-0975996cb407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:05:56 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Volume volume-7662194e-cafb-4d0c-828c-01dcee522ac4 (7662194e-cafb-4d0c-828c-01dcee522ac4): created successfully
Sep 07 18:05:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d073db1-8906-43c9-b179-0975996cb407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:05:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Flow 'volume_create_manager' (2e1bf4f9-044e-44bb-add1-e955710e6b7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:05:56 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b456790c-186d-457e-9ec1-d4dbd72a9a91 tempest-VolumesTransfersTest-603778115 None] Created volume successfully.
Sep 07 18:05:56 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aaf4b86e-74b4-4bef-8276-2ab4fbefb394 tempest-AttachVolumeTestJSON-728677255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8d106bea-32d3-4b32-a54d-5e6e830f17b4" returned: 0 in 0.478s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aaf4b86e-74b4-4bef-8276-2ab4fbefb394 tempest-AttachVolumeTestJSON-728677255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8d106bea-32d3-4b32-a54d-5e6e830f17b4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:56 devstack sudo[95199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8d106bea-32d3-4b32-a54d-5e6e830f17b4
Sep 07 18:05:56 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:57 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aaf4b86e-74b4-4bef-8276-2ab4fbefb394 tempest-AttachVolumeTestJSON-728677255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8d106bea-32d3-4b32-a54d-5e6e830f17b4" returned: 0 in 0.272s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-aaf4b86e-74b4-4bef-8276-2ab4fbefb394 tempest-AttachVolumeTestJSON-728677255 None] Lock "cinder-quobyte-8d106bea-32d3-4b32-a54d-5e6e830f17b4" released by "delete_volume" :: held 0.818s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:57 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-aaf4b86e-74b4-4bef-8276-2ab4fbefb394 tempest-AttachVolumeTestJSON-728677255 None] Created reservations ['ba6b0c11-e92d-4e30-88b2-c2fa3b531a0d', '82ce43aa-5da1-455a-9315-fc990cf35e00', 'f4d0542c-e714-4982-8892-2e7514208de4', '941feb01-1af8-4bfa-a789-9b86408d7605'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:05:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-aaf4b86e-74b4-4bef-8276-2ab4fbefb394 tempest-AttachVolumeTestJSON-728677255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-aaf4b86e-74b4-4bef-8276-2ab4fbefb394 tempest-AttachVolumeTestJSON-728677255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:57 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-aaf4b86e-74b4-4bef-8276-2ab4fbefb394 tempest-AttachVolumeTestJSON-728677255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:05:57 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-aaf4b86e-74b4-4bef-8276-2ab4fbefb394 tempest-AttachVolumeTestJSON-728677255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:05:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-aaf4b86e-74b4-4bef-8276-2ab4fbefb394 tempest-AttachVolumeTestJSON-728677255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aaf4b86e-74b4-4bef-8276-2ab4fbefb394 tempest-AttachVolumeTestJSON-728677255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:57 devstack sudo[95202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:05:57 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:57 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aaf4b86e-74b4-4bef-8276-2ab4fbefb394 tempest-AttachVolumeTestJSON-728677255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.293s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:57 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-aaf4b86e-74b4-4bef-8276-2ab4fbefb394 tempest-AttachVolumeTestJSON-728677255 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:05:57 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-aaf4b86e-74b4-4bef-8276-2ab4fbefb394 tempest-AttachVolumeTestJSON-728677255 None] Deleted volume successfully.
Sep 07 18:05:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-acf06cf0-240f-40c0-9e6b-268ead8a593c tempest-AttachVolumeTestJSON-728677255 None] Acquiring lock "cinder-8bae9a47-665f-483a-ac78-93d171141ed0-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-aaf4b86e-74b4-4bef-8276-2ab4fbefb394 tempest-AttachVolumeTestJSON-728677255 None] Lock "cinder-8d106bea-32d3-4b32-a54d-5e6e830f17b4-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-acf06cf0-240f-40c0-9e6b-268ead8a593c tempest-AttachVolumeTestJSON-728677255 None] Lock "cinder-8bae9a47-665f-483a-ac78-93d171141ed0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-acf06cf0-240f-40c0-9e6b-268ead8a593c tempest-AttachVolumeTestJSON-728677255 None] Acquiring lock "cinder-quobyte-8bae9a47-665f-483a-ac78-93d171141ed0" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-acf06cf0-240f-40c0-9e6b-268ead8a593c tempest-AttachVolumeTestJSON-728677255 None] Lock "cinder-quobyte-8bae9a47-665f-483a-ac78-93d171141ed0" acquired by "delete_volume" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:57 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f1068d-18fa-4d7a-bdbe-ecd563e5fde2]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:05:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-acf06cf0-240f-40c0-9e6b-268ead8a593c tempest-AttachVolumeTestJSON-728677255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8bae9a47-665f-483a-ac78-93d171141ed0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:57 devstack sudo[95205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8bae9a47-665f-483a-ac78-93d171141ed0
Sep 07 18:05:57 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:58 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-acf06cf0-240f-40c0-9e6b-268ead8a593c tempest-AttachVolumeTestJSON-728677255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8bae9a47-665f-483a-ac78-93d171141ed0" returned: 0 in 0.420s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-acf06cf0-240f-40c0-9e6b-268ead8a593c tempest-AttachVolumeTestJSON-728677255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8bae9a47-665f-483a-ac78-93d171141ed0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:58 devstack sudo[95211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8bae9a47-665f-483a-ac78-93d171141ed0
Sep 07 18:05:58 devstack sudo[95211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:58 devstack sudo[95211]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-acf06cf0-240f-40c0-9e6b-268ead8a593c tempest-AttachVolumeTestJSON-728677255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8bae9a47-665f-483a-ac78-93d171141ed0" returned: 0 in 0.397s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-acf06cf0-240f-40c0-9e6b-268ead8a593c tempest-AttachVolumeTestJSON-728677255 None] Lock "cinder-quobyte-8bae9a47-665f-483a-ac78-93d171141ed0" released by "delete_volume" :: held 0.876s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:58 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-acf06cf0-240f-40c0-9e6b-268ead8a593c tempest-AttachVolumeTestJSON-728677255 None] Created reservations ['93ea9738-cbe6-4cd4-a6a3-c754b5f61f6d', 'f115b375-d017-47d6-a1ee-14350fd87ab6', 'a41bdf7c-92c1-4bc3-b196-bf8793877324', 'afbf360c-29dc-434e-9765-6b11de9a539a'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:05:58 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-7150127a-6d6f-44a9-bb9a-2cc8bb8676df tempest-VolumesTransfersTest-715402843 None] Transfer volume completed successfully.
Sep 07 18:05:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-acf06cf0-240f-40c0-9e6b-268ead8a593c tempest-AttachVolumeTestJSON-728677255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:05:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-acf06cf0-240f-40c0-9e6b-268ead8a593c tempest-AttachVolumeTestJSON-728677255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:05:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-acf06cf0-240f-40c0-9e6b-268ead8a593c tempest-AttachVolumeTestJSON-728677255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:05:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-acf06cf0-240f-40c0-9e6b-268ead8a593c tempest-AttachVolumeTestJSON-728677255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:05:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-acf06cf0-240f-40c0-9e6b-268ead8a593c tempest-AttachVolumeTestJSON-728677255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:05:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-acf06cf0-240f-40c0-9e6b-268ead8a593c tempest-AttachVolumeTestJSON-728677255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:58 devstack sudo[95215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:05:58 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:05:59 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root
Sep 07 18:05:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-acf06cf0-240f-40c0-9e6b-268ead8a593c tempest-AttachVolumeTestJSON-728677255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.349s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:05:59 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-acf06cf0-240f-40c0-9e6b-268ead8a593c tempest-AttachVolumeTestJSON-728677255 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:05:59 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-acf06cf0-240f-40c0-9e6b-268ead8a593c tempest-AttachVolumeTestJSON-728677255 None] Deleted volume successfully.
Sep 07 18:05:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-acf06cf0-240f-40c0-9e6b-268ead8a593c tempest-AttachVolumeTestJSON-728677255 None] Lock "cinder-8bae9a47-665f-483a-ac78-93d171141ed0-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:05:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-34d0455c-a395-40b3-9905-a706c317ffd4 tempest-VolumesTransfersTest-389807473 None] Acquiring lock "cinder-7662194e-cafb-4d0c-828c-01dcee522ac4-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-34d0455c-a395-40b3-9905-a706c317ffd4 tempest-VolumesTransfersTest-389807473 None] Lock "cinder-7662194e-cafb-4d0c-828c-01dcee522ac4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-34d0455c-a395-40b3-9905-a706c317ffd4 tempest-VolumesTransfersTest-389807473 None] Acquiring lock "cinder-quobyte-7662194e-cafb-4d0c-828c-01dcee522ac4" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:05:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-34d0455c-a395-40b3-9905-a706c317ffd4 tempest-VolumesTransfersTest-389807473 None] Lock "cinder-quobyte-7662194e-cafb-4d0c-828c-01dcee522ac4" acquired by "delete_volume" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:05:59 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[11721f69-62ed-488a-8fdc-7c6fdfe4d7b9]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:05:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-34d0455c-a395-40b3-9905-a706c317ffd4 tempest-VolumesTransfersTest-389807473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7662194e-cafb-4d0c-828c-01dcee522ac4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:05:59 devstack sudo[95218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7662194e-cafb-4d0c-828c-01dcee522ac4
Sep 07 18:05:59 devstack sudo[95218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:00 devstack sudo[95218]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-34d0455c-a395-40b3-9905-a706c317ffd4 tempest-VolumesTransfersTest-389807473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7662194e-cafb-4d0c-828c-01dcee522ac4" returned: 0 in 0.508s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-34d0455c-a395-40b3-9905-a706c317ffd4 tempest-VolumesTransfersTest-389807473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7662194e-cafb-4d0c-828c-01dcee522ac4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:00 devstack sudo[95223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7662194e-cafb-4d0c-828c-01dcee522ac4
Sep 07 18:06:00 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:00 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-34d0455c-a395-40b3-9905-a706c317ffd4 tempest-VolumesTransfersTest-389807473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7662194e-cafb-4d0c-828c-01dcee522ac4" returned: 0 in 0.311s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-34d0455c-a395-40b3-9905-a706c317ffd4 tempest-VolumesTransfersTest-389807473 None] Lock "cinder-quobyte-7662194e-cafb-4d0c-828c-01dcee522ac4" released by "delete_volume" :: held 0.869s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:06:00 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-34d0455c-a395-40b3-9905-a706c317ffd4 tempest-VolumesTransfersTest-389807473 None] Created reservations ['7c6c2037-e0a3-4039-894f-111c8ac8f302', '1ea09e53-d23f-43f6-839f-f2e8b97873b9', '0566fb3c-6bb6-40cf-9d7a-654aa67cdbe6', 'e6e6c3b0-7cbf-4df0-b7ab-16a9cd17e115'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:06:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-34d0455c-a395-40b3-9905-a706c317ffd4 tempest-VolumesTransfersTest-389807473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-34d0455c-a395-40b3-9905-a706c317ffd4 tempest-VolumesTransfersTest-389807473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-34d0455c-a395-40b3-9905-a706c317ffd4 tempest-VolumesTransfersTest-389807473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:06:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-34d0455c-a395-40b3-9905-a706c317ffd4 tempest-VolumesTransfersTest-389807473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:06:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-34d0455c-a395-40b3-9905-a706c317ffd4 tempest-VolumesTransfersTest-389807473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-34d0455c-a395-40b3-9905-a706c317ffd4 tempest-VolumesTransfersTest-389807473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:00 devstack sudo[95226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:06:00 devstack sudo[95226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:00 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:06:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:06:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:06:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:00 devstack sudo[95228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:06:00 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:01 devstack sudo[95226]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-34d0455c-a395-40b3-9905-a706c317ffd4 tempest-VolumesTransfersTest-389807473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.496s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-34d0455c-a395-40b3-9905-a706c317ffd4 tempest-VolumesTransfersTest-389807473 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:06:01 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-34d0455c-a395-40b3-9905-a706c317ffd4 tempest-VolumesTransfersTest-389807473 None] Deleted volume successfully.
Sep 07 18:06:01 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.374s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-34d0455c-a395-40b3-9905-a706c317ffd4 tempest-VolumesTransfersTest-389807473 None] Lock "cinder-7662194e-cafb-4d0c-828c-01dcee522ac4-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread info: [<_MainThread(MainThread, started 137533762306176)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137533650971072)>, <Thread(Thread-3 (stat_writer), started daemon 137533647226880)>, <Thread(Rabbit-heartbeat, started daemon 137533647437120)>, <Thread(Thread-5 (_runner), started daemon 137533648120896)>, <Thread(Thread-7 (_runner), started daemon 137533648182592)>, <Thread(fd_logger, started daemon 137533644336576)>, <Thread(privsep_reader, started daemon 137533643255424)>, <Thread(tpool_thread_0, started daemon 137533635446464)>, <Thread(tpool_thread_1, started daemon 137533627053760)>, <Thread(tpool_thread_2, started daemon 137533618661056)>, <Thread(tpool_thread_3, started daemon 137533610251968)>, <Thread(tpool_thread_4, started daemon 137533601842880)>, <Thread(tpool_thread_5, started daemon 137533593433792)>, <Thread(tpool_thread_6, started daemon 137533585024704)>, <Thread(tpool_thread_7, started daemon 137533576615616)>, <Thread(tpool_thread_8, started daemon 137533568206528)>, <Thread(tpool_thread_9, started daemon 137533559797440)>, <Thread(tpool_thread_10, started daemon 137533551388352)>, <Thread(tpool_thread_11, started daemon 137533542979264)>, <Thread(tpool_thread_12, started daemon 137533534570176)>, <Thread(tpool_thread_13, started daemon 137533526161088)>, <Thread(tpool_thread_14, started daemon 137533517752000)>, <Thread(tpool_thread_15, started daemon 137533509342912)>, <Thread(tpool_thread_16, started daemon 137533500933824)>, <Thread(tpool_thread_17, started daemon 137533492524736)>, <Thread(tpool_thread_18, started daemon 137533484115648)>, <Thread(tpool_thread_19, started daemon 137533475706560)>] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Flow 'volume_create_manager' (4721f6c1-ab12-43a7-a722-a4c80def7d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40dca7c9-195e-4cdc-b024-cceab6256aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40dca7c9-195e-4cdc-b024-cceab6256aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-357398846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=850a25b7-6983-4d68-88ea-b9536990f804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834f3beb9aa943488a0cd6de07375309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:06:02Z,use_quota=True,user_id='94729f6ee52b473ab31087977fa906eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0a5577-31cc-468e-a9a9-244fafd4a646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0a5577-31cc-468e-a9a9-244fafd4a646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3fd7cf0-7230-474f-98f1-1b78a185fae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3fd7cf0-7230-474f-98f1-1b78a185fae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '850a25b7-6983-4d68-88ea-b9536990f804', 'volume_name': 'volume-850a25b7-6983-4d68-88ea-b9536990f804', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ca651e-d73d-4565-8704-76257e73afcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ca651e-d73d-4565-8704-76257e73afcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19364eb-e21a-4a4f-800f-82f09f285fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:01 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Volume 850a25b7-6983-4d68-88ea-b9536990f804: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-850a25b7-6983-4d68-88ea-b9536990f804', 'volume_size': 1}
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-357398846',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=850a25b7-6983-4d68-88ea-b9536990f804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834f3beb9aa943488a0cd6de07375309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:06:02Z,use_quota=True,user_id='94729f6ee52b473ab31087977fa906eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Creating volume 850a25b7-6983-4d68-88ea-b9536990f804 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:06:01 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:06:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-850a25b7-6983-4d68-88ea-b9536990f804 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:01 devstack sudo[95232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-850a25b7-6983-4d68-88ea-b9536990f804 1073741824
Sep 07 18:06:01 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:02 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-850a25b7-6983-4d68-88ea-b9536990f804 1073741824" returned: 0 in 0.558s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-850a25b7-6983-4d68-88ea-b9536990f804 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:02 devstack sudo[95274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-850a25b7-6983-4d68-88ea-b9536990f804
Sep 07 18:06:02 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:02 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-850a25b7-6983-4d68-88ea-b9536990f804" returned: 0 in 0.384s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:06:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e19364eb-e21a-4a4f-800f-82f09f285fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-850a25b7-6983-4d68-88ea-b9536990f804', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c38b83-5ba4-4cdc-983d-330affef2878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:02 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Volume volume-850a25b7-6983-4d68-88ea-b9536990f804 (850a25b7-6983-4d68-88ea-b9536990f804): created successfully
Sep 07 18:06:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c38b83-5ba4-4cdc-983d-330affef2878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Flow 'volume_create_manager' (4721f6c1-ab12-43a7-a722-a4c80def7d25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:06:02 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-17912b58-7c03-4d59-9252-372a886bc12e tempest-VolumesTransfersTest-603778115 None] Created volume successfully.
Sep 07 18:06:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-469f8c9e-d6a9-4c68-a17e-d37b9562fd33 tempest-VolumesTransfersTest-389807473 None] Acquiring lock "cinder-850a25b7-6983-4d68-88ea-b9536990f804-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:06:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-469f8c9e-d6a9-4c68-a17e-d37b9562fd33 tempest-VolumesTransfersTest-389807473 None] Lock "cinder-850a25b7-6983-4d68-88ea-b9536990f804-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:06:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-469f8c9e-d6a9-4c68-a17e-d37b9562fd33 tempest-VolumesTransfersTest-389807473 None] Acquiring lock "cinder-quobyte-850a25b7-6983-4d68-88ea-b9536990f804" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:06:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-469f8c9e-d6a9-4c68-a17e-d37b9562fd33 tempest-VolumesTransfersTest-389807473 None] Lock "cinder-quobyte-850a25b7-6983-4d68-88ea-b9536990f804" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:06:04 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe189cb-91cc-4779-94cd-f29c327ed197]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:06:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-469f8c9e-d6a9-4c68-a17e-d37b9562fd33 tempest-VolumesTransfersTest-389807473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-850a25b7-6983-4d68-88ea-b9536990f804 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:04 devstack sudo[95279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-850a25b7-6983-4d68-88ea-b9536990f804
Sep 07 18:06:04 devstack sudo[95279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:04 devstack sudo[95279]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-469f8c9e-d6a9-4c68-a17e-d37b9562fd33 tempest-VolumesTransfersTest-389807473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-850a25b7-6983-4d68-88ea-b9536990f804" returned: 0 in 0.399s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-469f8c9e-d6a9-4c68-a17e-d37b9562fd33 tempest-VolumesTransfersTest-389807473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-850a25b7-6983-4d68-88ea-b9536990f804 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:04 devstack sudo[95284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-850a25b7-6983-4d68-88ea-b9536990f804
Sep 07 18:06:04 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:04 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-469f8c9e-d6a9-4c68-a17e-d37b9562fd33 tempest-VolumesTransfersTest-389807473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-850a25b7-6983-4d68-88ea-b9536990f804" returned: 0 in 0.276s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-469f8c9e-d6a9-4c68-a17e-d37b9562fd33 tempest-VolumesTransfersTest-389807473 None] Lock "cinder-quobyte-850a25b7-6983-4d68-88ea-b9536990f804" released by "delete_volume" :: held 0.715s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:06:04 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-469f8c9e-d6a9-4c68-a17e-d37b9562fd33 tempest-VolumesTransfersTest-389807473 None] Created reservations ['eeed2768-a0ae-40bb-a984-60d52ea2c82b', '72d8c436-6640-43c5-906f-82d175c0344f', '1f04f0ab-aed9-4ea9-85b4-5630cc0acb38', '303ec2cd-ceab-4dbd-8f00-a46d7146e8a6'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:06:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-469f8c9e-d6a9-4c68-a17e-d37b9562fd33 tempest-VolumesTransfersTest-389807473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-469f8c9e-d6a9-4c68-a17e-d37b9562fd33 tempest-VolumesTransfersTest-389807473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-469f8c9e-d6a9-4c68-a17e-d37b9562fd33 tempest-VolumesTransfersTest-389807473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:06:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-469f8c9e-d6a9-4c68-a17e-d37b9562fd33 tempest-VolumesTransfersTest-389807473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:06:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-469f8c9e-d6a9-4c68-a17e-d37b9562fd33 tempest-VolumesTransfersTest-389807473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-469f8c9e-d6a9-4c68-a17e-d37b9562fd33 tempest-VolumesTransfersTest-389807473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:04 devstack sudo[95287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:06:04 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:05 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-469f8c9e-d6a9-4c68-a17e-d37b9562fd33 tempest-VolumesTransfersTest-389807473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.378s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:05 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-469f8c9e-d6a9-4c68-a17e-d37b9562fd33 tempest-VolumesTransfersTest-389807473 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:06:05 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-469f8c9e-d6a9-4c68-a17e-d37b9562fd33 tempest-VolumesTransfersTest-389807473 None] Deleted volume successfully.
Sep 07 18:06:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-469f8c9e-d6a9-4c68-a17e-d37b9562fd33 tempest-VolumesTransfersTest-389807473 None] Lock "cinder-850a25b7-6983-4d68-88ea-b9536990f804-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:06:14 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=96,cinder:DELETE=10,cinder:UPDATE=121,cinder:INSERT=26 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:06:15 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=112,cinder:UPDATE=136,cinder:INSERT=36,cinder:DELETE=11 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:06:16 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:06:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Flow 'volume_create_manager' (cb379a5c-afdf-4faf-9836-d4cb8cb80596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:06:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8892d73a-115d-4569-9739-f11bd9ab5f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8892d73a-115d-4569-9739-f11bd9ab5f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-402895797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d959f37e8094b8dbdff2b865b4cf431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:06:16Z,use_quota=True,user_id='d683211e763f4568bab8ea0f5e863347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (291c97e1-e1fa-4bbc-ad55-4175f9b66ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (291c97e1-e1fa-4bbc-ad55-4175f9b66ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a8935c3-5951-4cba-ab8e-a9b0a98c615b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a8935c3-5951-4cba-ab8e-a9b0a98c615b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62', 'volume_name': 'volume-df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f90580c-3422-4f63-a95b-017e0d32d792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f90580c-3422-4f63-a95b-017e0d32d792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07be24c2-528e-41e6-98ea-6602892269a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:16 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Volume df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62', 'volume_size': 1}
Sep 07 18:06:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:06:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-402895797',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d959f37e8094b8dbdff2b865b4cf431',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:06:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:06:16Z,use_quota=True,user_id='d683211e763f4568bab8ea0f5e863347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:06:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Creating volume df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:06:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:06:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:06:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:06:16 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:06:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:16 devstack sudo[95297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62 1073741824
Sep 07 18:06:16 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:17 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62 1073741824" returned: 0 in 0.682s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:17 devstack sudo[95303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62
Sep 07 18:06:17 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:17 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62" returned: 0 in 0.370s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:06:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07be24c2-528e-41e6-98ea-6602892269a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac5b9787-829f-4b49-89ce-858b22422e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:17 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Volume volume-df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62 (df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62): created successfully
Sep 07 18:06:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac5b9787-829f-4b49-89ce-858b22422e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Flow 'volume_create_manager' (cb379a5c-afdf-4faf-9836-d4cb8cb80596) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:06:17 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-a8282137-af3d-4e3d-9b98-d0c11f91766f req-13f51d6a-ae28-4a54-bdf0-2dfea266e65a tempest-VolumesGetTestJSON-1198410043 None] Created volume successfully.
Sep 07 18:06:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-660f2b76-639c-4f8b-ac99-00c2bb10b5e4 req-560806dc-76a8-4886-ac3a-32430f05beec tempest-VolumesGetTestJSON-1198410043 None] Acquiring lock "cinder-df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:06:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-660f2b76-639c-4f8b-ac99-00c2bb10b5e4 req-560806dc-76a8-4886-ac3a-32430f05beec tempest-VolumesGetTestJSON-1198410043 None] Lock "cinder-df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:06:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-660f2b76-639c-4f8b-ac99-00c2bb10b5e4 req-560806dc-76a8-4886-ac3a-32430f05beec tempest-VolumesGetTestJSON-1198410043 None] Acquiring lock "cinder-quobyte-df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:06:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-660f2b76-639c-4f8b-ac99-00c2bb10b5e4 req-560806dc-76a8-4886-ac3a-32430f05beec tempest-VolumesGetTestJSON-1198410043 None] Lock "cinder-quobyte-df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:06:19 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a8ea51-bb41-476d-b0f8-de7a2de0037f]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:06:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-660f2b76-639c-4f8b-ac99-00c2bb10b5e4 req-560806dc-76a8-4886-ac3a-32430f05beec tempest-VolumesGetTestJSON-1198410043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:19 devstack sudo[95322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62
Sep 07 18:06:19 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:19 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-660f2b76-639c-4f8b-ac99-00c2bb10b5e4 req-560806dc-76a8-4886-ac3a-32430f05beec tempest-VolumesGetTestJSON-1198410043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62" returned: 0 in 0.498s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-660f2b76-639c-4f8b-ac99-00c2bb10b5e4 req-560806dc-76a8-4886-ac3a-32430f05beec tempest-VolumesGetTestJSON-1198410043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:19 devstack sudo[95327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62
Sep 07 18:06:19 devstack sudo[95327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:20 devstack sudo[95327]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-660f2b76-639c-4f8b-ac99-00c2bb10b5e4 req-560806dc-76a8-4886-ac3a-32430f05beec tempest-VolumesGetTestJSON-1198410043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62" returned: 0 in 0.366s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-660f2b76-639c-4f8b-ac99-00c2bb10b5e4 req-560806dc-76a8-4886-ac3a-32430f05beec tempest-VolumesGetTestJSON-1198410043 None] Lock "cinder-quobyte-df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62" released by "delete_volume" :: held 0.948s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:06:20 devstack cinder-volume[87269]: DEBUG cinder.quota [req-660f2b76-639c-4f8b-ac99-00c2bb10b5e4 req-560806dc-76a8-4886-ac3a-32430f05beec tempest-VolumesGetTestJSON-1198410043 None] Created reservations ['06eecf68-6a89-4cb5-8086-65620e83b5fe', 'cfa17abd-0a03-4e49-8495-7bc0b682d117', 'c24a9b89-44c7-4eab-ab50-de0e0bd8a774', 'd73a138e-35b7-4510-9529-35d2ccc14b60'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:06:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-660f2b76-639c-4f8b-ac99-00c2bb10b5e4 req-560806dc-76a8-4886-ac3a-32430f05beec tempest-VolumesGetTestJSON-1198410043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-660f2b76-639c-4f8b-ac99-00c2bb10b5e4 req-560806dc-76a8-4886-ac3a-32430f05beec tempest-VolumesGetTestJSON-1198410043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-660f2b76-639c-4f8b-ac99-00c2bb10b5e4 req-560806dc-76a8-4886-ac3a-32430f05beec tempest-VolumesGetTestJSON-1198410043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:06:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-660f2b76-639c-4f8b-ac99-00c2bb10b5e4 req-560806dc-76a8-4886-ac3a-32430f05beec tempest-VolumesGetTestJSON-1198410043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:06:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-660f2b76-639c-4f8b-ac99-00c2bb10b5e4 req-560806dc-76a8-4886-ac3a-32430f05beec tempest-VolumesGetTestJSON-1198410043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-660f2b76-639c-4f8b-ac99-00c2bb10b5e4 req-560806dc-76a8-4886-ac3a-32430f05beec tempest-VolumesGetTestJSON-1198410043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:20 devstack sudo[95330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:06:20 devstack sudo[95330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:20 devstack sudo[95330]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-660f2b76-639c-4f8b-ac99-00c2bb10b5e4 req-560806dc-76a8-4886-ac3a-32430f05beec tempest-VolumesGetTestJSON-1198410043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.337s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:20 devstack cinder-volume[87269]: DEBUG cinder.manager [req-660f2b76-639c-4f8b-ac99-00c2bb10b5e4 req-560806dc-76a8-4886-ac3a-32430f05beec tempest-VolumesGetTestJSON-1198410043 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:06:20 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-660f2b76-639c-4f8b-ac99-00c2bb10b5e4 req-560806dc-76a8-4886-ac3a-32430f05beec tempest-VolumesGetTestJSON-1198410043 None] Deleted volume successfully.
Sep 07 18:06:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-660f2b76-639c-4f8b-ac99-00c2bb10b5e4 req-560806dc-76a8-4886-ac3a-32430f05beec tempest-VolumesGetTestJSON-1198410043 None] Lock "cinder-df1ed9e1-7fae-4ec2-bb81-b8cd4089cd62-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:06:23 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:06:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Flow 'volume_create_manager' (28b667a9-45e8-4d0f-859e-c2decf39c9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:06:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (972c3bc1-0453-4919-a70a-7fcc1ecbf79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (972c3bc1-0453-4919-a70a-7fcc1ecbf79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-293856759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13a55f57-e545-479e-8d06-a0e4a9c2b617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3713a23cca1a4c85b1d3b5d9af5cd11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:06:23Z,use_quota=True,user_id='40fed196d962459f86ab28c9ee408572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (883c7849-ea37-4c72-b624-c64d4a2a8fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (883c7849-ea37-4c72-b624-c64d4a2a8fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7adf375-4bb8-4ceb-ad9d-0fb15ba29bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7adf375-4bb8-4ceb-ad9d-0fb15ba29bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13a55f57-e545-479e-8d06-a0e4a9c2b617', 'volume_name': 'volume-13a55f57-e545-479e-8d06-a0e4a9c2b617', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef7a300-9337-4851-9d1f-cb7a06a463a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef7a300-9337-4851-9d1f-cb7a06a463a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71fee806-e290-40e0-b5dc-3fd02552ee9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:23 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Volume 13a55f57-e545-479e-8d06-a0e4a9c2b617: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13a55f57-e545-479e-8d06-a0e4a9c2b617', 'volume_size': 1}
Sep 07 18:06:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:06:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-293856759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13a55f57-e545-479e-8d06-a0e4a9c2b617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3713a23cca1a4c85b1d3b5d9af5cd11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:06:23Z,use_quota=True,user_id='40fed196d962459f86ab28c9ee408572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:06:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Creating volume 13a55f57-e545-479e-8d06-a0e4a9c2b617 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:06:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:06:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:06:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:06:23 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:06:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:23 devstack sudo[95411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617 1073741824
Sep 07 18:06:23 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:24 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:06:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Flow 'volume_create_manager' (2dd7007a-7138-495a-81a8-fcaca5ef3226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:06:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1cdbd3-fbe6-4e3a-bec7-e3d3f8e44bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1cdbd3-fbe6-4e3a-bec7-e3d3f8e44bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-148948605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce14004-9163-4f09-9f36-cc6816f0a7f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23e77415fc53472aa7d6b69a076bd0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:06:24Z,use_quota=True,user_id='69f54d85979c4fd8b2a0ae465419c6d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9a8365-6a6b-461c-b7cd-795fb39ab2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f9a8365-6a6b-461c-b7cd-795fb39ab2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:24 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f87932d6-b7bf-4070-9dee-3dad4cd582ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:24 devstack cinder-volume[87269]: DEBUG cinder.image.glance [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Creating Keystone auth plugin from conf {{(pid=87269) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 07 18:06:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617 1073741824" returned: 0 in 0.792s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:24 devstack sudo[95417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617
Sep 07 18:06:24 devstack sudo[95417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:24 devstack sudo[95417]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617" returned: 0 in 0.332s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:06:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71fee806-e290-40e0-b5dc-3fd02552ee9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13a55f57-e545-479e-8d06-a0e4a9c2b617', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d768d82-a50f-43cd-af0f-232e5bb5da08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:24 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Volume volume-13a55f57-e545-479e-8d06-a0e4a9c2b617 (13a55f57-e545-479e-8d06-a0e4a9c2b617): created successfully
Sep 07 18:06:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d768d82-a50f-43cd-af0f-232e5bb5da08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Flow 'volume_create_manager' (28b667a9-45e8-4d0f-859e-c2decf39c9d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:06:24 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-98c838e9-dc88-48d5-9454-454795031c58 tempest-VolumesCloneTest-1558339232 None] Created volume successfully.
Sep 07 18:06:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f87932d6-b7bf-4070-9dee-3dad4cd582ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1ce14004-9163-4f09-9f36-cc6816f0a7f4', 'volume_name': 'volume-1ce14004-9163-4f09-9f36-cc6816f0a7f4', 'volume_size': 1, 'image_id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72845066d7f346c6b304e9cfe8bcc9a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'created_at': datetime.datetime(2026, 9, 7, 15, 54, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d160ba7d940>}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b346baf-b16e-48e2-99d1-e10bb8dfcce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b346baf-b16e-48e2-99d1-e10bb8dfcce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07bab01-b195-4764-bd5a-31d2d5092ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:24 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Volume 1ce14004-9163-4f09-9f36-cc6816f0a7f4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1ce14004-9163-4f09-9f36-cc6816f0a7f4', 'volume_size': 1, 'image_id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72845066d7f346c6b304e9cfe8bcc9a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'created_at': datetime.datetime(2026, 9, 7, 15, 54, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d160ba7d940>}
Sep 07 18:06:24 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Trying to clone 1ce14004-9163-4f09-9f36-cc6816f0a7f4 from image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}]). {{(pid=87269) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 07 18:06:25 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_n0g3h09vdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 07 18:06:25 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Image download 20.69 MB at 20.69 MB/s
Sep 07 18:06:25 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cc43cd-f3d6-485d-96d2-376aab660d7e]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:06:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_n0g3h09vdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:25 devstack sudo[95421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_n0g3h09vdevstack@QuobyteHD
Sep 07 18:06:25 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:26 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_n0g3h09vdevstack@QuobyteHD" returned: 0 in 0.627s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:26 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Temporary image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 is fetched for user 69f54d85979c4fd8b2a0ae465419c6d0. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 07 18:06:26 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaee2aa-f4d5-48dc-ae9b-01068b68d41b]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:06:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_n0g3h09vdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:26 devstack sudo[95431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_n0g3h09vdevstack@QuobyteHD
Sep 07 18:06:26 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:26 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:06:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Flow 'volume_create_manager' (a41f9b24-11a3-4155-a49c-a85325b07a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:06:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b9395f-3600-4cc3-b75e-f1f3804c6fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1b9395f-3600-4cc3-b75e-f1f3804c6fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1946977461',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=016679ad-1511-4e38-aed1-244edd1b0518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3713a23cca1a4c85b1d3b5d9af5cd11b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:06:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=13a55f57-e545-479e-8d06-a0e4a9c2b617,status='creating',terminated_at=None,updated_at=2026-09-07T16:06:27Z,use_quota=True,user_id='40fed196d962459f86ab28c9ee408572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b7d6ed-fba1-4767-8e2f-59faf4bb6c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b7d6ed-fba1-4767-8e2f-59faf4bb6c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6732325-a3ca-4a93-8305-1d9e68c7cf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6732325-a3ca-4a93-8305-1d9e68c7cf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '016679ad-1511-4e38-aed1-244edd1b0518', 'volume_name': 'volume-016679ad-1511-4e38-aed1-244edd1b0518', 'volume_size': 2, 'source_volid': '13a55f57-e545-479e-8d06-a0e4a9c2b617', 'source_volstatus': 'available'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff33368-7f12-4fb5-ac38-19b9acc64e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff33368-7f12-4fb5-ac38-19b9acc64e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56610c71-2a1e-42b0-9624-6cebb42e02ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:26 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Volume 016679ad-1511-4e38-aed1-244edd1b0518: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-016679ad-1511-4e38-aed1-244edd1b0518', 'volume_size': 2, 'source_volid': '13a55f57-e545-479e-8d06-a0e4a9c2b617', 'source_volstatus': 'available'}
Sep 07 18:06:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:26 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Cloning volume 13a55f57-e545-479e-8d06-a0e4a9c2b617 to volume 016679ad-1511-4e38-aed1-244edd1b0518
Sep 07 18:06:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Creating offline snapshot c4e9a59b-9083-4273-b558-146dd6cd5f7d of volume 13a55f57-e545-479e-8d06-a0e4a9c2b617 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:06:26 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_n0g3h09vdevstack@QuobyteHD" returned: 0 in 0.439s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:26 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1e81d0-93ab-4a8f-924a-58addea0c38d]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:06:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:27 devstack sudo[95437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617
Sep 07 18:06:27 devstack sudo[95437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:27 devstack sudo[95437]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617" returned: 0 in 0.606s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.c4e9a59b-9083-4273-b558-146dd6cd5f7d 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:27 devstack sudo[95443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.c4e9a59b-9083-4273-b558-146dd6cd5f7d 1G
Sep 07 18:06:27 devstack sudo[95443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:28 devstack sudo[95443]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.c4e9a59b-9083-4273-b558-146dd6cd5f7d 1G" returned: 0 in 0.649s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13a55f57-e545-479e-8d06-a0e4a9c2b617 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.c4e9a59b-9083-4273-b558-146dd6cd5f7d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:28 devstack sudo[95449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13a55f57-e545-479e-8d06-a0e4a9c2b617 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.c4e9a59b-9083-4273-b558-146dd6cd5f7d
Sep 07 18:06:28 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:28 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13a55f57-e545-479e-8d06-a0e4a9c2b617 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.c4e9a59b-9083-4273-b558-146dd6cd5f7d" returned: 0 in 0.676s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:28 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.c4e9a59b-9083-4273-b558-146dd6cd5f7d is being set with open permissions: ugo+rw
Sep 07 18:06:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.c4e9a59b-9083-4273-b558-146dd6cd5f7d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:28 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-abb4aa6b-05db-44b3-a8b1-ae73702fa7b8 tempest-GroupsTest-2106406133 None] Group tempest-Group1-426985855: creating
Sep 07 18:06:28 devstack sudo[95466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.c4e9a59b-9083-4273-b558-146dd6cd5f7d
Sep 07 18:06:28 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:28 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-abb4aa6b-05db-44b3-a8b1-ae73702fa7b8 tempest-GroupsTest-2106406133 None] Group tempest-Group1-426985855: created successfully
Sep 07 18:06:29 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-abb4aa6b-05db-44b3-a8b1-ae73702fa7b8 tempest-GroupsTest-2106406133 None] Create group completed successfully.
Sep 07 18:06:29 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.c4e9a59b-9083-4273-b558-146dd6cd5f7d" returned: 0 in 0.442s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:29 devstack sudo[95474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.info
Sep 07 18:06:29 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:29 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.info" returned: 0 in 0.355s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:29 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.info is being set with open permissions: ugo+rw
Sep 07 18:06:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:29 devstack sudo[95477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.info
Sep 07 18:06:29 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:30 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.info" returned: 0 in 0.380s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Acquiring lock "cinder-quobyte-016679ad-1511-4e38-aed1-244edd1b0518" by "_copy_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:06:30 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ffeebea8-2b34-4924-98b1-92368c9f4e86 tempest-GroupsTest-2106406133 None] Group tempest-Group2-877351941: creating
Sep 07 18:06:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Lock "cinder-quobyte-016679ad-1511-4e38-aed1-244edd1b0518" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:06:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] snapshot: c4e9a59b-9083-4273-b558-146dd6cd5f7d, volume: 016679ad-1511-4e38-aed1-244edd1b0518,  {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 07 18:06:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:06:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:06:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:30 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ffeebea8-2b34-4924-98b1-92368c9f4e86 tempest-GroupsTest-2106406133 None] Group tempest-Group2-877351941: created successfully
Sep 07 18:06:30 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a025b3f7-0c3d-4274-9c31-90155abaf3d6]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:06:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.c4e9a59b-9083-4273-b558-146dd6cd5f7d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:30 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ffeebea8-2b34-4924-98b1-92368c9f4e86 tempest-GroupsTest-2106406133 None] Create group completed successfully.
Sep 07 18:06:30 devstack sudo[95480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.c4e9a59b-9083-4273-b558-146dd6cd5f7d
Sep 07 18:06:30 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:30 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.c4e9a59b-9083-4273-b558-146dd6cd5f7d" returned: 0 in 0.508s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13a55f57-e545-479e-8d06-a0e4a9c2b617(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:06:30 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1698281f-13b1-4b6d-855b-af2e992be7d5]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:06:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:30 devstack sudo[95487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617
Sep 07 18:06:30 devstack sudo[95487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:31 devstack sudo[95487]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617" returned: 0 in 0.462s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] will copy from snapshot at /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617 {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 07 18:06:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Creating direct copy from snapshot {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 07 18:06:31 devstack cinder-volume[87269]: DEBUG cinder.utils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Path /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-016679ad-1511-4e38-aed1-244edd1b0518 not found in is_blk_device check {{(pid=87269) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 07 18:06:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-016679ad-1511-4e38-aed1-244edd1b0518 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:31 devstack sudo[95492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-016679ad-1511-4e38-aed1-244edd1b0518
Sep 07 18:06:31 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:32 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:06:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Flow 'volume_create_manager' (ded22977-64f0-4e8a-b1f1-73a298c37ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:06:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc6d920-8510-4d45-b0d1-401f0caea982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc6d920-8510-4d45-b0d1-401f0caea982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-473383927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a3a630ce-51b5-43b5-be36-a038f6659cfa,host='devstack@QuobyteHD#QuobyteHD',id=ce2b9f69-df2f-4787-b837-76deb0255bbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3270c1f252f24bdd9b0684f625e0e3a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:06:33Z,use_quota=True,user_id='989f60dc45464fd0ade60f2310523084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e01ced8-0dbe-4ff6-889a-435db665678a),volume_type_id=9e01ced8-0dbe-4ff6-889a-435db665678a)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (608cdf58-d86d-4351-ac4c-89b76228c5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (608cdf58-d86d-4351-ac4c-89b76228c5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee7fc8c-0835-4d03-86c9-013acd68cd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee7fc8c-0835-4d03-86c9-013acd68cd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce2b9f69-df2f-4787-b837-76deb0255bbb', 'volume_name': 'volume-ce2b9f69-df2f-4787-b837-76deb0255bbb', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ecc6be-064b-4b1b-b3d3-f9a61f81170c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49ecc6be-064b-4b1b-b3d3-f9a61f81170c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0771d98d-48aa-44d5-8472-6237303bbff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:33 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Volume ce2b9f69-df2f-4787-b837-76deb0255bbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce2b9f69-df2f-4787-b837-76deb0255bbb', 'volume_size': 1}
Sep 07 18:06:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:39 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-016679ad-1511-4e38-aed1-244edd1b0518" returned: 0 in 8.359s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:39 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Image conversion details: src /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617, size 1024.00 MB, duration 8.36 sec, destination /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-016679ad-1511-4e38-aed1-244edd1b0518 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 07 18:06:39 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Converted 1024.00 MB image at 122.48 MB/s
Sep 07 18:06:39 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-016679ad-1511-4e38-aed1-244edd1b0518 is being set with open permissions: ugo+rw
Sep 07 18:06:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-016679ad-1511-4e38-aed1-244edd1b0518 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:39 devstack sudo[95605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-016679ad-1511-4e38-aed1-244edd1b0518
Sep 07 18:06:39 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:39 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-016679ad-1511-4e38-aed1-244edd1b0518" returned: 0 in 0.263s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Lock "cinder-quobyte-016679ad-1511-4e38-aed1-244edd1b0518" released by "_copy_volume_from_snapshot" :: held 9.678s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:06:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Acquiring lock "cinder-quobyte-c4e9a59b-9083-4273-b558-146dd6cd5f7d" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:06:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Lock "cinder-quobyte-c4e9a59b-9083-4273-b558-146dd6cd5f7d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:06:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Deleting offline snapshot c4e9a59b-9083-4273-b558-146dd6cd5f7d of volume 13a55f57-e545-479e-8d06-a0e4a9c2b617 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:06:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] snapshot_file for this snap is: volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.c4e9a59b-9083-4273-b558-146dd6cd5f7d {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:06:39 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e18b5e-b29a-4dbb-b95a-5cfeff9721bd]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:06:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.c4e9a59b-9083-4273-b558-146dd6cd5f7d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:40 devstack sudo[95609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.c4e9a59b-9083-4273-b558-146dd6cd5f7d
Sep 07 18:06:40 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:40 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.c4e9a59b-9083-4273-b558-146dd6cd5f7d" returned: 0 in 0.450s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13a55f57-e545-479e-8d06-a0e4a9c2b617(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:06:40 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae200a45-3a5e-44af-b183-22667a665407]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:06:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:40 devstack sudo[95620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617
Sep 07 18:06:40 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:40 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617" returned: 0 in 0.625s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.c4e9a59b-9083-4273-b558-146dd6cd5f7d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:41 devstack sudo[95629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.c4e9a59b-9083-4273-b558-146dd6cd5f7d
Sep 07 18:06:41 devstack sudo[95629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:41 devstack sudo[95629]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.c4e9a59b-9083-4273-b558-146dd6cd5f7d" returned: 0 in 0.348s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.c4e9a59b-9083-4273-b558-146dd6cd5f7d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:41 devstack sudo[95635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.c4e9a59b-9083-4273-b558-146dd6cd5f7d
Sep 07 18:06:41 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:41 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617.c4e9a59b-9083-4273-b558-146dd6cd5f7d" returned: 0 in 0.254s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Lock "cinder-quobyte-c4e9a59b-9083-4273-b558-146dd6cd5f7d" released by "_delete_snapshot" :: held 1.794s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.832s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.766s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-148948605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce14004-9163-4f09-9f36-cc6816f0a7f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23e77415fc53472aa7d6b69a076bd0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:06:24Z,use_quota=True,user_id='69f54d85979c4fd8b2a0ae465419c6d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Creating volume 1ce14004-9163-4f09-9f36-cc6816f0a7f4 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:06:41 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1ce14004-9163-4f09-9f36-cc6816f0a7f4 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:41 devstack sudo[95638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1ce14004-9163-4f09-9f36-cc6816f0a7f4 1073741824
Sep 07 18:06:41 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56610c71-2a1e-42b0-9624-6cebb42e02ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-016679ad-1511-4e38-aed1-244edd1b0518', 'volume_size': 2, 'source_volid': '13a55f57-e545-479e-8d06-a0e4a9c2b617', 'source_volstatus': 'available'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9556c932-a04a-47cc-8101-8f2121fe98fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:41 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Volume volume-016679ad-1511-4e38-aed1-244edd1b0518 (016679ad-1511-4e38-aed1-244edd1b0518): created successfully
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9556c932-a04a-47cc-8101-8f2121fe98fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Flow 'volume_create_manager' (a41f9b24-11a3-4155-a49c-a85325b07a05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:06:41 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0c4ea314-117f-4db1-a20d-203b657a16b1 tempest-VolumesCloneTest-1558339232 None] Created volume successfully.
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Flow 'volume_create_manager' (68db35e3-dc34-4b17-b95f-9f57bec6ea70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f488f8e-c164-4c83-aadd-5ffefc6b14a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f488f8e-c164-4c83-aadd-5ffefc6b14a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1974398105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=426b7e93-864c-41d0-98b6-79975b21531f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd9db53870a4bff9851cd857b7f98ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:06:42Z,use_quota=True,user_id='7496fc8dfdff461da1d42baf7bcc2487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2836ccde-c479-462f-8391-15fa96a01631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2836ccde-c479-462f-8391-15fa96a01631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (773b10df-33ad-4b61-b8c3-c163b570611f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (773b10df-33ad-4b61-b8c3-c163b570611f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '426b7e93-864c-41d0-98b6-79975b21531f', 'volume_name': 'volume-426b7e93-864c-41d0-98b6-79975b21531f', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff7c6fc-6770-40cb-8fa0-54d6e7aaabc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff7c6fc-6770-40cb-8fa0-54d6e7aaabc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f915fc35-a8fd-4890-8db5-047b0a10d4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:42 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Volume 426b7e93-864c-41d0-98b6-79975b21531f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-426b7e93-864c-41d0-98b6-79975b21531f', 'volume_size': 1}
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:42 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1ce14004-9163-4f09-9f36-cc6816f0a7f4 1073741824" returned: 0 in 0.508s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-80852977-1f61-4ac3-8850-0b60f253d0f2 tempest-VolumesCloneTest-1558339232 None] Acquiring lock "cinder-016679ad-1511-4e38-aed1-244edd1b0518-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-80852977-1f61-4ac3-8850-0b60f253d0f2 tempest-VolumesCloneTest-1558339232 None] Lock "cinder-016679ad-1511-4e38-aed1-244edd1b0518-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1ce14004-9163-4f09-9f36-cc6816f0a7f4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:42 devstack sudo[95644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1ce14004-9163-4f09-9f36-cc6816f0a7f4
Sep 07 18:06:42 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-80852977-1f61-4ac3-8850-0b60f253d0f2 tempest-VolumesCloneTest-1558339232 None] Acquiring lock "cinder-quobyte-016679ad-1511-4e38-aed1-244edd1b0518" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-80852977-1f61-4ac3-8850-0b60f253d0f2 tempest-VolumesCloneTest-1558339232 None] Lock "cinder-quobyte-016679ad-1511-4e38-aed1-244edd1b0518" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[285ab0ad-8697-4886-b907-f44991b146d8]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-80852977-1f61-4ac3-8850-0b60f253d0f2 tempest-VolumesCloneTest-1558339232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-016679ad-1511-4e38-aed1-244edd1b0518 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:42 devstack sudo[95646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-016679ad-1511-4e38-aed1-244edd1b0518
Sep 07 18:06:42 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:42 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1ce14004-9163-4f09-9f36-cc6816f0a7f4" returned: 0 in 0.263s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.348s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a3a630ce-51b5-43b5-be36-a038f6659cfa,created_at=2026-09-07T16:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-473383927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a3a630ce-51b5-43b5-be36-a038f6659cfa,host='devstack@QuobyteHD#QuobyteHD',id=ce2b9f69-df2f-4787-b837-76deb0255bbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3270c1f252f24bdd9b0684f625e0e3a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:06:33Z,use_quota=True,user_id='989f60dc45464fd0ade60f2310523084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e01ced8-0dbe-4ff6-889a-435db665678a),volume_type_id=9e01ced8-0dbe-4ff6-889a-435db665678a)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Creating volume ce2b9f69-df2f-4787-b837-76deb0255bbb {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:06:42 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ce2b9f69-df2f-4787-b837-76deb0255bbb 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:42 devstack sudo[95649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ce2b9f69-df2f-4787-b837-76deb0255bbb 1073741824
Sep 07 18:06:42 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Attempting download of 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 ((None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}])) to volume 1ce14004-9163-4f09-9f36-cc6816f0a7f4. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b83ac3-7f3a-4c9c-b903-c6561eb1b331]: (4, 'raw') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_448ka5n2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:42 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-80852977-1f61-4ac3-8850-0b60f253d0f2 tempest-VolumesCloneTest-1558339232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-016679ad-1511-4e38-aed1-244edd1b0518" returned: 0 in 0.387s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-80852977-1f61-4ac3-8850-0b60f253d0f2 tempest-VolumesCloneTest-1558339232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-016679ad-1511-4e38-aed1-244edd1b0518 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:42 devstack sudo[95655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-016679ad-1511-4e38-aed1-244edd1b0518
Sep 07 18:06:42 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:42 devstack sudo[95651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_448ka5n2
Sep 07 18:06:42 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:42 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ce2b9f69-df2f-4787-b837-76deb0255bbb 1073741824" returned: 0 in 0.434s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:42 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_448ka5n2" returned: 0 in 0.362s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_448ka5n2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:43 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-80852977-1f61-4ac3-8850-0b60f253d0f2 tempest-VolumesCloneTest-1558339232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-016679ad-1511-4e38-aed1-244edd1b0518" returned: 0 in 0.281s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ce2b9f69-df2f-4787-b837-76deb0255bbb {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-80852977-1f61-4ac3-8850-0b60f253d0f2 tempest-VolumesCloneTest-1558339232 None] Lock "cinder-quobyte-016679ad-1511-4e38-aed1-244edd1b0518" released by "delete_volume" :: held 0.724s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:06:43 devstack sudo[95665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ce2b9f69-df2f-4787-b837-76deb0255bbb
Sep 07 18:06:43 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-80852977-1f61-4ac3-8850-0b60f253d0f2 tempest-VolumesCloneTest-1558339232 None] Created reservations ['98dce731-0796-4715-b0de-3ffc98f06d54', '5d0edae7-e3be-4314-929c-8318a92cfb4e', 'a2198bd9-2bc4-4a6b-8b8a-322e574041e0', 'bd88e4ef-f656-43db-b4e4-8b12a69a0f79'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:06:43 devstack sudo[95664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_448ka5n2
Sep 07 18:06:43 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-80852977-1f61-4ac3-8850-0b60f253d0f2 tempest-VolumesCloneTest-1558339232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-80852977-1f61-4ac3-8850-0b60f253d0f2 tempest-VolumesCloneTest-1558339232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-80852977-1f61-4ac3-8850-0b60f253d0f2 tempest-VolumesCloneTest-1558339232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-80852977-1f61-4ac3-8850-0b60f253d0f2 tempest-VolumesCloneTest-1558339232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-80852977-1f61-4ac3-8850-0b60f253d0f2 tempest-VolumesCloneTest-1558339232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-80852977-1f61-4ac3-8850-0b60f253d0f2 tempest-VolumesCloneTest-1558339232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:43 devstack sudo[95668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:06:43 devstack sudo[95668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:43 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ce2b9f69-df2f-4787-b837-76deb0255bbb" returned: 0 in 0.266s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.303s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1974398105',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=426b7e93-864c-41d0-98b6-79975b21531f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd9db53870a4bff9851cd857b7f98ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:06:42Z,use_quota=True,user_id='7496fc8dfdff461da1d42baf7bcc2487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Creating volume 426b7e93-864c-41d0-98b6-79975b21531f {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:06:43 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-426b7e93-864c-41d0-98b6-79975b21531f 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:43 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0771d98d-48aa-44d5-8472-6237303bbff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce2b9f69-df2f-4787-b837-76deb0255bbb', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:43 devstack sudo[95673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-426b7e93-864c-41d0-98b6-79975b21531f 1073741824
Sep 07 18:06:43 devstack sudo[95673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f9fa84-4d62-48cf-9778-47bfb85bf792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_448ka5n2" returned: 1 in 0.379s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_448ka5n2' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f6c8c8-f7c6-4944-910b-99e8107ae4c1]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_n0g3h09vdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:43 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Volume volume-ce2b9f69-df2f-4787-b837-76deb0255bbb (ce2b9f69-df2f-4787-b837-76deb0255bbb): created successfully
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f9fa84-4d62-48cf-9778-47bfb85bf792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Flow 'volume_create_manager' (ded22977-64f0-4e8a-b1f1-73a298c37ad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:06:43 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-00059c20-f15d-4029-ab7a-e7b3819aed68 tempest-GroupsTest-2106406133 None] Created volume successfully.
Sep 07 18:06:43 devstack sudo[95668]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-dab7f4f8-1fd3-45b7-ab1a-00bce54a9094 tempest-VolumesCloneTest-1558339232 None] Acquiring lock "cinder-13a55f57-e545-479e-8d06-a0e4a9c2b617-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-80852977-1f61-4ac3-8850-0b60f253d0f2 tempest-VolumesCloneTest-1558339232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.348s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-80852977-1f61-4ac3-8850-0b60f253d0f2 tempest-VolumesCloneTest-1558339232 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:06:43 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-80852977-1f61-4ac3-8850-0b60f253d0f2 tempest-VolumesCloneTest-1558339232 None] Deleted volume successfully.
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-dab7f4f8-1fd3-45b7-ab1a-00bce54a9094 tempest-VolumesCloneTest-1558339232 None] Lock "cinder-13a55f57-e545-479e-8d06-a0e4a9c2b617-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-80852977-1f61-4ac3-8850-0b60f253d0f2 tempest-VolumesCloneTest-1558339232 None] Lock "cinder-016679ad-1511-4e38-aed1-244edd1b0518-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-dab7f4f8-1fd3-45b7-ab1a-00bce54a9094 tempest-VolumesCloneTest-1558339232 None] Acquiring lock "cinder-quobyte-13a55f57-e545-479e-8d06-a0e4a9c2b617" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-dab7f4f8-1fd3-45b7-ab1a-00bce54a9094 tempest-VolumesCloneTest-1558339232 None] Lock "cinder-quobyte-13a55f57-e545-479e-8d06-a0e4a9c2b617" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:06:43 devstack sudo[95675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_n0g3h09vdevstack@QuobyteHD
Sep 07 18:06:43 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[845451bc-450d-4795-8478-d47d42e030ee]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dab7f4f8-1fd3-45b7-ab1a-00bce54a9094 tempest-VolumesCloneTest-1558339232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:43 devstack sudo[95681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617
Sep 07 18:06:43 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:43 devstack sudo[95673]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-426b7e93-864c-41d0-98b6-79975b21531f 1073741824" returned: 0 in 0.504s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:43 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_n0g3h09vdevstack@QuobyteHD" returned: 0 in 0.479s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 was qcow2, converting to qcow2 {{(pid=87269) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_n0g3h09vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1ce14004-9163-4f09-9f36-cc6816f0a7f4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-426b7e93-864c-41d0-98b6-79975b21531f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:43 devstack sudo[95687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_n0g3h09vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1ce14004-9163-4f09-9f36-cc6816f0a7f4
Sep 07 18:06:43 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:43 devstack sudo[95688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-426b7e93-864c-41d0-98b6-79975b21531f
Sep 07 18:06:43 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:44 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dab7f4f8-1fd3-45b7-ab1a-00bce54a9094 tempest-VolumesCloneTest-1558339232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617" returned: 0 in 0.396s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dab7f4f8-1fd3-45b7-ab1a-00bce54a9094 tempest-VolumesCloneTest-1558339232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:44 devstack sudo[95694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617
Sep 07 18:06:44 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:44 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-426b7e93-864c-41d0-98b6-79975b21531f" returned: 0 in 0.269s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:06:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f915fc35-a8fd-4890-8db5-047b0a10d4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-426b7e93-864c-41d0-98b6-79975b21531f', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45bdb378-55c5-4374-9d9a-95c7666df232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:44 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Volume volume-426b7e93-864c-41d0-98b6-79975b21531f (426b7e93-864c-41d0-98b6-79975b21531f): created successfully
Sep 07 18:06:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45bdb378-55c5-4374-9d9a-95c7666df232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Flow 'volume_create_manager' (68db35e3-dc34-4b17-b95f-9f57bec6ea70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:06:44 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ef50ffe8-9825-4203-8590-449c5c713097 tempest-ServersNegativeTestJSON-1079388712 None] Created volume successfully.
Sep 07 18:06:44 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dab7f4f8-1fd3-45b7-ab1a-00bce54a9094 tempest-VolumesCloneTest-1558339232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-13a55f57-e545-479e-8d06-a0e4a9c2b617" returned: 0 in 0.271s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-dab7f4f8-1fd3-45b7-ab1a-00bce54a9094 tempest-VolumesCloneTest-1558339232 None] Lock "cinder-quobyte-13a55f57-e545-479e-8d06-a0e4a9c2b617" released by "delete_volume" :: held 0.727s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:06:44 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-dab7f4f8-1fd3-45b7-ab1a-00bce54a9094 tempest-VolumesCloneTest-1558339232 None] Created reservations ['c852ee9d-eba4-4ad8-9dc3-dc14d4554a80', '6c583d06-26dc-42a7-992e-5558c1ace288', 'dac43b9b-92b8-4b76-a88e-ead03f599354', '6c5ac55f-c3b0-4087-84a3-81632385feef'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:06:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dab7f4f8-1fd3-45b7-ab1a-00bce54a9094 tempest-VolumesCloneTest-1558339232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dab7f4f8-1fd3-45b7-ab1a-00bce54a9094 tempest-VolumesCloneTest-1558339232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dab7f4f8-1fd3-45b7-ab1a-00bce54a9094 tempest-VolumesCloneTest-1558339232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:06:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dab7f4f8-1fd3-45b7-ab1a-00bce54a9094 tempest-VolumesCloneTest-1558339232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:06:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dab7f4f8-1fd3-45b7-ab1a-00bce54a9094 tempest-VolumesCloneTest-1558339232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dab7f4f8-1fd3-45b7-ab1a-00bce54a9094 tempest-VolumesCloneTest-1558339232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:44 devstack sudo[95705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:06:44 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:44 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dab7f4f8-1fd3-45b7-ab1a-00bce54a9094 tempest-VolumesCloneTest-1558339232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.322s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:44 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-dab7f4f8-1fd3-45b7-ab1a-00bce54a9094 tempest-VolumesCloneTest-1558339232 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:06:44 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-dab7f4f8-1fd3-45b7-ab1a-00bce54a9094 tempest-VolumesCloneTest-1558339232 None] Deleted volume successfully.
Sep 07 18:06:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-dab7f4f8-1fd3-45b7-ab1a-00bce54a9094 tempest-VolumesCloneTest-1558339232 None] Lock "cinder-13a55f57-e545-479e-8d06-a0e4a9c2b617-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:06:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-311ae9a4-36b5-48f5-87a8-f7b1270ca390 tempest-GroupsTest-2106406133 None] Acquiring lock "cinder-quobyte-ce2b9f69-df2f-4787-b837-76deb0255bbb" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:06:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-311ae9a4-36b5-48f5-87a8-f7b1270ca390 tempest-GroupsTest-2106406133 None] Lock "cinder-quobyte-ce2b9f69-df2f-4787-b837-76deb0255bbb" acquired by "delete_volume" :: waited 0.038s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:06:45 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c10322-3fb5-4336-812e-f807bdeb2f8f]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:06:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-311ae9a4-36b5-48f5-87a8-f7b1270ca390 tempest-GroupsTest-2106406133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ce2b9f69-df2f-4787-b837-76deb0255bbb {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:46 devstack sudo[95709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ce2b9f69-df2f-4787-b837-76deb0255bbb
Sep 07 18:06:46 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:46 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_n0g3h09vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1ce14004-9163-4f09-9f36-cc6816f0a7f4" returned: 0 in 2.464s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:46 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_n0g3h09vdevstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1ce14004-9163-4f09-9f36-cc6816f0a7f4 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 07 18:06:46 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Converted 112.00 MB image at 45.39 MB/s
Sep 07 18:06:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1ce14004-9163-4f09-9f36-cc6816f0a7f4 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:46 devstack sudo[95711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1ce14004-9163-4f09-9f36-cc6816f0a7f4 1G
Sep 07 18:06:46 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:46 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-311ae9a4-36b5-48f5-87a8-f7b1270ca390 tempest-GroupsTest-2106406133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ce2b9f69-df2f-4787-b837-76deb0255bbb" returned: 0 in 0.580s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-311ae9a4-36b5-48f5-87a8-f7b1270ca390 tempest-GroupsTest-2106406133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ce2b9f69-df2f-4787-b837-76deb0255bbb {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:46 devstack sudo[95716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ce2b9f69-df2f-4787-b837-76deb0255bbb
Sep 07 18:06:46 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:46 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1ce14004-9163-4f09-9f36-cc6816f0a7f4 1G" returned: 0 in 0.466s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:46 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Downloaded image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 ((None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}])) to volume 1ce14004-9163-4f09-9f36-cc6816f0a7f4 successfully. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 07 18:06:46 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Temporary image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 for user 69f54d85979c4fd8b2a0ae465419c6d0 is deleted. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 07 18:06:46 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Marking volume 1ce14004-9163-4f09-9f36-cc6816f0a7f4 as bootable. {{(pid=87269) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 07 18:06:46 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Copying metadata from image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 to 1ce14004-9163-4f09-9f36-cc6816f0a7f4. {{(pid=87269) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 07 18:06:46 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Creating volume glance metadata for volume 1ce14004-9163-4f09-9f36-cc6816f0a7f4 backed by image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87269) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 07 18:06:46 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-311ae9a4-36b5-48f5-87a8-f7b1270ca390 tempest-GroupsTest-2106406133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ce2b9f69-df2f-4787-b837-76deb0255bbb" returned: 0 in 0.355s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-311ae9a4-36b5-48f5-87a8-f7b1270ca390 tempest-GroupsTest-2106406133 None] Lock "cinder-quobyte-ce2b9f69-df2f-4787-b837-76deb0255bbb" released by "delete_volume" :: held 1.044s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:06:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07bab01-b195-4764-bd5a-31d2d5092ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ce14004-9163-4f09-9f36-cc6816f0a7f4', 'volume_size': 1, 'image_id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72845066d7f346c6b304e9cfe8bcc9a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'created_at': datetime.datetime(2026, 9, 7, 15, 54, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d160ba7d940>}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59cd8683-09e0-478b-8bd1-c5930e5aaf0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:47 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Volume volume-1ce14004-9163-4f09-9f36-cc6816f0a7f4 (1ce14004-9163-4f09-9f36-cc6816f0a7f4): created successfully
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59cd8683-09e0-478b-8bd1-c5930e5aaf0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Flow 'volume_create_manager' (2dd7007a-7138-495a-81a8-fcaca5ef3226) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:06:47 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-fa4594f6-18e7-496f-87c0-faa8581f455e tempest-TestShelveInstance-2081596184 None] Created volume successfully.
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-311ae9a4-36b5-48f5-87a8-f7b1270ca390 tempest-GroupsTest-2106406133 None] Created reservations ['a470f29b-9664-44bc-b815-ac4b3b64fe32'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:06:47 devstack cinder-volume[87269]: WARNING cinder.quota [None req-311ae9a4-36b5-48f5-87a8-f7b1270ca390 tempest-GroupsTest-2106406133 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1922137391 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1922137391, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:06:47 devstack cinder-volume[87269]: WARNING cinder.quota [None req-311ae9a4-36b5-48f5-87a8-f7b1270ca390 tempest-GroupsTest-2106406133 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1922137391 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1922137391, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-311ae9a4-36b5-48f5-87a8-f7b1270ca390 tempest-GroupsTest-2106406133 None] Created reservations ['5e777cb5-ab48-4daf-8966-b67e656b0947', 'f0ebe724-b5f8-48dc-854d-c8d837506f35', 'be296fea-8fed-4cbb-b48b-d96014bbf0f6', '1fa7a55e-795a-454b-a379-6347bf4aaa2d'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-311ae9a4-36b5-48f5-87a8-f7b1270ca390 tempest-GroupsTest-2106406133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-311ae9a4-36b5-48f5-87a8-f7b1270ca390 tempest-GroupsTest-2106406133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-311ae9a4-36b5-48f5-87a8-f7b1270ca390 tempest-GroupsTest-2106406133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-311ae9a4-36b5-48f5-87a8-f7b1270ca390 tempest-GroupsTest-2106406133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-311ae9a4-36b5-48f5-87a8-f7b1270ca390 tempest-GroupsTest-2106406133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-311ae9a4-36b5-48f5-87a8-f7b1270ca390 tempest-GroupsTest-2106406133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:47 devstack sudo[95723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:06:47 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Flow 'volume_create_manager' (8b2e35bb-4e65-4e66-b9a0-ca3d4d32e203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a47ee54-36a0-4303-bbca-d6f781ccc80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a47ee54-36a0-4303-bbca-d6f781ccc80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-315115859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f21205-e97e-4a5a-b651-69a09f266947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd9db53870a4bff9851cd857b7f98ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:06:47Z,use_quota=True,user_id='7496fc8dfdff461da1d42baf7bcc2487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fabe053-550a-4d86-bc80-5be13a0d7f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fabe053-550a-4d86-bc80-5be13a0d7f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c7cb326-e791-4b32-a622-dd9512e5d1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c7cb326-e791-4b32-a622-dd9512e5d1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0f21205-e97e-4a5a-b651-69a09f266947', 'volume_name': 'volume-f0f21205-e97e-4a5a-b651-69a09f266947', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f7412c-c58d-4156-9214-5693bfdceb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7f7412c-c58d-4156-9214-5693bfdceb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeae4f70-abc7-49d7-8bac-0d63acf38f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:47 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Volume f0f21205-e97e-4a5a-b651-69a09f266947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0f21205-e97e-4a5a-b651-69a09f266947', 'volume_size': 1}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:06:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-315115859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f21205-e97e-4a5a-b651-69a09f266947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd9db53870a4bff9851cd857b7f98ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:06:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:06:47Z,use_quota=True,user_id='7496fc8dfdff461da1d42baf7bcc2487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Creating volume f0f21205-e97e-4a5a-b651-69a09f266947 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:06:47 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f0f21205-e97e-4a5a-b651-69a09f266947 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:47 devstack sudo[95726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f0f21205-e97e-4a5a-b651-69a09f266947 1073741824
Sep 07 18:06:47 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:47 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-311ae9a4-36b5-48f5-87a8-f7b1270ca390 tempest-GroupsTest-2106406133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.324s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:47 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-311ae9a4-36b5-48f5-87a8-f7b1270ca390 tempest-GroupsTest-2106406133 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:06:47 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-311ae9a4-36b5-48f5-87a8-f7b1270ca390 tempest-GroupsTest-2106406133 None] Delete group completed successfully.
Sep 07 18:06:48 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f0f21205-e97e-4a5a-b651-69a09f266947 1073741824" returned: 0 in 0.485s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f0f21205-e97e-4a5a-b651-69a09f266947 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:48 devstack sudo[95732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f0f21205-e97e-4a5a-b651-69a09f266947
Sep 07 18:06:48 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:48 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f0f21205-e97e-4a5a-b651-69a09f266947" returned: 0 in 0.338s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:06:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeae4f70-abc7-49d7-8bac-0d63acf38f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0f21205-e97e-4a5a-b651-69a09f266947', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbd83512-799c-4a06-8693-f777d558e8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:48 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Volume volume-f0f21205-e97e-4a5a-b651-69a09f266947 (f0f21205-e97e-4a5a-b651-69a09f266947): created successfully
Sep 07 18:06:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbd83512-799c-4a06-8693-f777d558e8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Flow 'volume_create_manager' (8b2e35bb-4e65-4e66-b9a0-ca3d4d32e203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:06:48 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-fe7a4790-5c96-47ab-a042-3c2437f56a9d tempest-ServersNegativeTestJSON-1079388712 None] Created volume successfully.
Sep 07 18:06:48 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-05761a79-0efa-405f-b26a-0661bdc589fb tempest-GroupsTest-2106406133 None] Created reservations ['cfba956e-af8d-4f2b-b945-bec7ed87d002'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:06:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-05761a79-0efa-405f-b26a-0661bdc589fb tempest-GroupsTest-2106406133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-05761a79-0efa-405f-b26a-0661bdc589fb tempest-GroupsTest-2106406133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-05761a79-0efa-405f-b26a-0661bdc589fb tempest-GroupsTest-2106406133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:06:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-05761a79-0efa-405f-b26a-0661bdc589fb tempest-GroupsTest-2106406133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:06:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-05761a79-0efa-405f-b26a-0661bdc589fb tempest-GroupsTest-2106406133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-05761a79-0efa-405f-b26a-0661bdc589fb tempest-GroupsTest-2106406133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:48 devstack sudo[95738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:06:48 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:48 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-05761a79-0efa-405f-b26a-0661bdc589fb tempest-GroupsTest-2106406133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.268s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:48 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-05761a79-0efa-405f-b26a-0661bdc589fb tempest-GroupsTest-2106406133 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:06:48 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-05761a79-0efa-405f-b26a-0661bdc589fb tempest-GroupsTest-2106406133 None] Delete group completed successfully.
Sep 07 18:06:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-21fe91ba-bbed-45f5-9467-44fa3d4b6f6f tempest-ServersNegativeTestJSON-1079388712 None] Acquiring lock "cinder-f0f21205-e97e-4a5a-b651-69a09f266947-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:06:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-21fe91ba-bbed-45f5-9467-44fa3d4b6f6f tempest-ServersNegativeTestJSON-1079388712 None] Lock "cinder-f0f21205-e97e-4a5a-b651-69a09f266947-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:06:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-21fe91ba-bbed-45f5-9467-44fa3d4b6f6f tempest-ServersNegativeTestJSON-1079388712 None] Acquiring lock "cinder-quobyte-f0f21205-e97e-4a5a-b651-69a09f266947" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:06:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-21fe91ba-bbed-45f5-9467-44fa3d4b6f6f tempest-ServersNegativeTestJSON-1079388712 None] Lock "cinder-quobyte-f0f21205-e97e-4a5a-b651-69a09f266947" acquired by "delete_volume" :: waited 0.032s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:06:50 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c0c5c3-4a0c-450f-a55d-7f13957d3fb1]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:06:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-21fe91ba-bbed-45f5-9467-44fa3d4b6f6f tempest-ServersNegativeTestJSON-1079388712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f0f21205-e97e-4a5a-b651-69a09f266947 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-e31f1738-2077-47f6-8da5-bf8d0576e9fe req-4f3d018e-bdfd-4fd6-b683-25ed286d50de tempest-TestShelveInstance-2081596184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-e31f1738-2077-47f6-8da5-bf8d0576e9fe req-4f3d018e-bdfd-4fd6-b683-25ed286d50de tempest-TestShelveInstance-2081596184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-e31f1738-2077-47f6-8da5-bf8d0576e9fe req-4f3d018e-bdfd-4fd6-b683-25ed286d50de tempest-TestShelveInstance-2081596184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:50 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:06:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Flow 'volume_create_manager' (de345707-96d8-4778-b8f5-f04f0f002d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:06:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba264b8-371b-49ce-b9f3-44937533705a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba264b8-371b-49ce-b9f3-44937533705a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-204659618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e71ae61d-3fdf-44ef-9ff3-787fdacee2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e140b1da1a1a45bf84cd86944a18dd88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:06:50Z,use_quota=True,user_id='77466947c3ef4ab4a8b85fe88ded1827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f6732d-df37-434a-8ec8-9769ce196ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f6732d-df37-434a-8ec8-9769ce196ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2f2893-fe73-4b6e-8f41-6ffe18d289ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:50 devstack cinder-volume[87269]: DEBUG cinder.image.glance [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Creating Keystone auth plugin from conf {{(pid=87269) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 07 18:06:50 devstack sudo[95750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f0f21205-e97e-4a5a-b651-69a09f266947
Sep 07 18:06:50 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-e31f1738-2077-47f6-8da5-bf8d0576e9fe req-4f3d018e-bdfd-4fd6-b683-25ed286d50de tempest-TestShelveInstance-2081596184 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d', 'name': 'volume-1ce14004-9163-4f09-9f36-cc6816f0a7f4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c0c3a26-5e06-49fc-b8c7-2b1a4c780910', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 07 18:06:50 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e96d69e6-3858-4832-8cc6-557555caa610 tempest-GroupsTest-2106406133 None] Group tempest-GroupsTest-Group-2070030013: creating
Sep 07 18:06:50 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-e31f1738-2077-47f6-8da5-bf8d0576e9fe req-4f3d018e-bdfd-4fd6-b683-25ed286d50de tempest-TestShelveInstance-2081596184 None] attachment_update completed successfully.
Sep 07 18:06:51 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e96d69e6-3858-4832-8cc6-557555caa610 tempest-GroupsTest-2106406133 None] Group tempest-GroupsTest-Group-2070030013: created successfully
Sep 07 18:06:51 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a2f2893-fe73-4b6e-8f41-6ffe18d289ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e71ae61d-3fdf-44ef-9ff3-787fdacee2c1', 'volume_name': 'volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1', 'volume_size': 1, 'image_id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72845066d7f346c6b304e9cfe8bcc9a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'created_at': datetime.datetime(2026, 9, 7, 15, 54, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d1601735310>}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8791b7-dc97-40d0-a4ba-f4100c02a406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8791b7-dc97-40d0-a4ba-f4100c02a406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7bc14bc-fa3f-4c75-9931-1155d94a09d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:51 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Volume e71ae61d-3fdf-44ef-9ff3-787fdacee2c1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1', 'volume_size': 1, 'image_id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72845066d7f346c6b304e9cfe8bcc9a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'created_at': datetime.datetime(2026, 9, 7, 15, 54, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d1601735310>}
Sep 07 18:06:51 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Trying to clone e71ae61d-3fdf-44ef-9ff3-787fdacee2c1 from image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}]). {{(pid=87269) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 07 18:06:51 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e96d69e6-3858-4832-8cc6-557555caa610 tempest-GroupsTest-2106406133 None] Create group completed successfully.
Sep 07 18:06:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-21fe91ba-bbed-45f5-9467-44fa3d4b6f6f tempest-ServersNegativeTestJSON-1079388712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f0f21205-e97e-4a5a-b651-69a09f266947" returned: 0 in 0.659s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-21fe91ba-bbed-45f5-9467-44fa3d4b6f6f tempest-ServersNegativeTestJSON-1079388712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f0f21205-e97e-4a5a-b651-69a09f266947 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:51 devstack sudo[95756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f0f21205-e97e-4a5a-b651-69a09f266947
Sep 07 18:06:51 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:51 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-21fe91ba-bbed-45f5-9467-44fa3d4b6f6f tempest-ServersNegativeTestJSON-1079388712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f0f21205-e97e-4a5a-b651-69a09f266947" returned: 0 in 0.361s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-21fe91ba-bbed-45f5-9467-44fa3d4b6f6f tempest-ServersNegativeTestJSON-1079388712 None] Lock "cinder-quobyte-f0f21205-e97e-4a5a-b651-69a09f266947" released by "delete_volume" :: held 1.130s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:06:51 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_9i68nxk1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 07 18:06:51 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Image download 20.69 MB at 20.69 MB/s
Sep 07 18:06:51 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-21fe91ba-bbed-45f5-9467-44fa3d4b6f6f tempest-ServersNegativeTestJSON-1079388712 None] Created reservations ['4c92be4e-6f7c-424f-974b-561db2d6f960', '1fe2bb9b-02cb-4be3-9dbc-cb20bbbc4e80', 'db9355ae-2460-48bc-8506-f4086dfa83ac', 'bc9ae800-8ad2-4be1-885f-4b8856516998'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:06:51 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[541ea919-d893-412f-b2a1-c6ba28e79597]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:06:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_9i68nxk1devstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-21fe91ba-bbed-45f5-9467-44fa3d4b6f6f tempest-ServersNegativeTestJSON-1079388712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-21fe91ba-bbed-45f5-9467-44fa3d4b6f6f tempest-ServersNegativeTestJSON-1079388712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-21fe91ba-bbed-45f5-9467-44fa3d4b6f6f tempest-ServersNegativeTestJSON-1079388712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:06:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-21fe91ba-bbed-45f5-9467-44fa3d4b6f6f tempest-ServersNegativeTestJSON-1079388712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:06:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-21fe91ba-bbed-45f5-9467-44fa3d4b6f6f tempest-ServersNegativeTestJSON-1079388712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-21fe91ba-bbed-45f5-9467-44fa3d4b6f6f tempest-ServersNegativeTestJSON-1079388712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:51 devstack sudo[95761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:06:51 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:51 devstack sudo[95760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_9i68nxk1devstack@QuobyteHD
Sep 07 18:06:51 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:52 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-21fe91ba-bbed-45f5-9467-44fa3d4b6f6f tempest-ServersNegativeTestJSON-1079388712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.297s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-21fe91ba-bbed-45f5-9467-44fa3d4b6f6f tempest-ServersNegativeTestJSON-1079388712 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:06:52 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-21fe91ba-bbed-45f5-9467-44fa3d4b6f6f tempest-ServersNegativeTestJSON-1079388712 None] Deleted volume successfully.
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-21fe91ba-bbed-45f5-9467-44fa3d4b6f6f tempest-ServersNegativeTestJSON-1079388712 None] Lock "cinder-f0f21205-e97e-4a5a-b651-69a09f266947-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:06:52 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_9i68nxk1devstack@QuobyteHD" returned: 0 in 0.446s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Temporary image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 is fetched for user 77466947c3ef4ab4a8b85fe88ded1827. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2db710-8f2c-4314-96fd-dd15055f0a64]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_9i68nxk1devstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:52 devstack sudo[95768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_9i68nxk1devstack@QuobyteHD
Sep 07 18:06:52 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:52 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Flow 'volume_create_manager' (5aea8318-4c95-4dd9-b540-04245a7ada36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4092208-a9ff-4ee5-84ee-013d6b092cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5e276883-c109-4f86-8b15-8c94d7ca2289 tempest-ServersNegativeTestJSON-1079388712 None] Acquiring lock "cinder-426b7e93-864c-41d0-98b6-79975b21531f-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_9i68nxk1devstack@QuobyteHD" returned: 0 in 0.537s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-204659618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e71ae61d-3fdf-44ef-9ff3-787fdacee2c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e140b1da1a1a45bf84cd86944a18dd88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:06:50Z,use_quota=True,user_id='77466947c3ef4ab4a8b85fe88ded1827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Creating volume e71ae61d-3fdf-44ef-9ff3-787fdacee2c1 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:06:52 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4092208-a9ff-4ee5-84ee-013d6b092cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-543130914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=380ef359-91ea-4631-8c79-a74f7b056b75,host='devstack@QuobyteHD#QuobyteHD',id=dea2bddc-41b0-4c36-bbfe-f49040d1d3b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3270c1f252f24bdd9b0684f625e0e3a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:06:53Z,use_quota=True,user_id='989f60dc45464fd0ade60f2310523084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65513b3c-c7e2-4a30-a168-ac95f6016e0b),volume_type_id=65513b3c-c7e2-4a30-a168-ac95f6016e0b)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df51d111-c6c2-49c2-8483-c8061290ba6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:52 devstack sudo[95774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1 1073741824
Sep 07 18:06:52 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df51d111-c6c2-49c2-8483-c8061290ba6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b6a7737-fe0c-4f94-bf50-33ebad79dc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b6a7737-fe0c-4f94-bf50-33ebad79dc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dea2bddc-41b0-4c36-bbfe-f49040d1d3b5', 'volume_name': 'volume-dea2bddc-41b0-4c36-bbfe-f49040d1d3b5', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37112357-bfa8-4080-99eb-dd500f9c42b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37112357-bfa8-4080-99eb-dd500f9c42b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c834a4c1-a86a-4304-be60-1b7e1cae29c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:52 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Volume dea2bddc-41b0-4c36-bbfe-f49040d1d3b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dea2bddc-41b0-4c36-bbfe-f49040d1d3b5', 'volume_size': 1}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5e276883-c109-4f86-8b15-8c94d7ca2289 tempest-ServersNegativeTestJSON-1079388712 None] Lock "cinder-426b7e93-864c-41d0-98b6-79975b21531f-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5e276883-c109-4f86-8b15-8c94d7ca2289 tempest-ServersNegativeTestJSON-1079388712 None] Acquiring lock "cinder-quobyte-426b7e93-864c-41d0-98b6-79975b21531f" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5e276883-c109-4f86-8b15-8c94d7ca2289 tempest-ServersNegativeTestJSON-1079388712 None] Lock "cinder-quobyte-426b7e93-864c-41d0-98b6-79975b21531f" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb54a5e-ad32-4336-919b-5eaf056c14fd]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:06:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5e276883-c109-4f86-8b15-8c94d7ca2289 tempest-ServersNegativeTestJSON-1079388712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-426b7e93-864c-41d0-98b6-79975b21531f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:53 devstack sudo[95776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-426b7e93-864c-41d0-98b6-79975b21531f
Sep 07 18:06:53 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:53 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1 1073741824" returned: 0 in 0.603s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:53 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5e276883-c109-4f86-8b15-8c94d7ca2289 tempest-ServersNegativeTestJSON-1079388712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-426b7e93-864c-41d0-98b6-79975b21531f" returned: 0 in 0.470s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5e276883-c109-4f86-8b15-8c94d7ca2289 tempest-ServersNegativeTestJSON-1079388712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-426b7e93-864c-41d0-98b6-79975b21531f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:53 devstack sudo[95852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-426b7e93-864c-41d0-98b6-79975b21531f
Sep 07 18:06:53 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:53 devstack sudo[95853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1
Sep 07 18:06:53 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:53 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5e276883-c109-4f86-8b15-8c94d7ca2289 tempest-ServersNegativeTestJSON-1079388712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-426b7e93-864c-41d0-98b6-79975b21531f" returned: 0 in 0.407s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5e276883-c109-4f86-8b15-8c94d7ca2289 tempest-ServersNegativeTestJSON-1079388712 None] Lock "cinder-quobyte-426b7e93-864c-41d0-98b6-79975b21531f" released by "delete_volume" :: held 0.963s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:06:53 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1" returned: 0 in 0.604s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:06:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.200s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=380ef359-91ea-4631-8c79-a74f7b056b75,created_at=2026-09-07T16:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-543130914',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=380ef359-91ea-4631-8c79-a74f7b056b75,host='devstack@QuobyteHD#QuobyteHD',id=dea2bddc-41b0-4c36-bbfe-f49040d1d3b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3270c1f252f24bdd9b0684f625e0e3a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:06:53Z,use_quota=True,user_id='989f60dc45464fd0ade60f2310523084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65513b3c-c7e2-4a30-a168-ac95f6016e0b),volume_type_id=65513b3c-c7e2-4a30-a168-ac95f6016e0b)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:06:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Creating volume dea2bddc-41b0-4c36-bbfe-f49040d1d3b5 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:06:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:06:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:06:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:06:54 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:06:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-dea2bddc-41b0-4c36-bbfe-f49040d1d3b5 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:54 devstack sudo[96203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-dea2bddc-41b0-4c36-bbfe-f49040d1d3b5 1073741824
Sep 07 18:06:54 devstack sudo[96203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:54 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Attempting download of 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 ((None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}])) to volume e71ae61d-3fdf-44ef-9ff3-787fdacee2c1. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 07 18:06:54 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-5e276883-c109-4f86-8b15-8c94d7ca2289 tempest-ServersNegativeTestJSON-1079388712 None] Created reservations ['d8487510-58b8-4080-82c4-f4741e85ede4', '2a1d62bd-0716-4fde-bb99-456e38aac18e', 'c3584cfe-7f55-456a-aa56-8ff0d66bd886', '0c7bf581-5e05-4301-933d-9f3eda83428c'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:06:54 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f78a175-815a-4ca4-9db4-308cb2a75d15]: (4, 'raw') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:06:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_7s8ztupn {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5e276883-c109-4f86-8b15-8c94d7ca2289 tempest-ServersNegativeTestJSON-1079388712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5e276883-c109-4f86-8b15-8c94d7ca2289 tempest-ServersNegativeTestJSON-1079388712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5e276883-c109-4f86-8b15-8c94d7ca2289 tempest-ServersNegativeTestJSON-1079388712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:06:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5e276883-c109-4f86-8b15-8c94d7ca2289 tempest-ServersNegativeTestJSON-1079388712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:06:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5e276883-c109-4f86-8b15-8c94d7ca2289 tempest-ServersNegativeTestJSON-1079388712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5e276883-c109-4f86-8b15-8c94d7ca2289 tempest-ServersNegativeTestJSON-1079388712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:54 devstack sudo[96222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:06:54 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:54 devstack sudo[96214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_7s8ztupn
Sep 07 18:06:54 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:54 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5e276883-c109-4f86-8b15-8c94d7ca2289 tempest-ServersNegativeTestJSON-1079388712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.549s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:54 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-5e276883-c109-4f86-8b15-8c94d7ca2289 tempest-ServersNegativeTestJSON-1079388712 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:06:54 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:54 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5e276883-c109-4f86-8b15-8c94d7ca2289 tempest-ServersNegativeTestJSON-1079388712 None] Deleted volume successfully.
Sep 07 18:06:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_7s8ztupn" returned: 0 in 0.712s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_7s8ztupn {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:55 devstack sudo[96203]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-dea2bddc-41b0-4c36-bbfe-f49040d1d3b5 1073741824" returned: 0 in 0.951s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5e276883-c109-4f86-8b15-8c94d7ca2289 tempest-ServersNegativeTestJSON-1079388712 None] Lock "cinder-426b7e93-864c-41d0-98b6-79975b21531f-delete_volume" released by "delete_volume" :: held 2.174s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:06:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-dea2bddc-41b0-4c36-bbfe-f49040d1d3b5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:55 devstack sudo[96248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-dea2bddc-41b0-4c36-bbfe-f49040d1d3b5
Sep 07 18:06:55 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:55 devstack sudo[96247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_7s8ztupn
Sep 07 18:06:55 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:55 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-dea2bddc-41b0-4c36-bbfe-f49040d1d3b5" returned: 0 in 0.327s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:06:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:55 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c834a4c1-a86a-4304-be60-1b7e1cae29c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dea2bddc-41b0-4c36-bbfe-f49040d1d3b5', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c9aff6-7b80-4cdb-b3b5-01442f474cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_7s8ztupn" returned: 1 in 0.433s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_7s8ztupn' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 07 18:06:55 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a19cf6-b074-431c-adff-9289f2c89c42]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:06:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_9i68nxk1devstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:55 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Volume volume-dea2bddc-41b0-4c36-bbfe-f49040d1d3b5 (dea2bddc-41b0-4c36-bbfe-f49040d1d3b5): created successfully
Sep 07 18:06:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c9aff6-7b80-4cdb-b3b5-01442f474cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:55 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Flow 'volume_create_manager' (5aea8318-4c95-4dd9-b540-04245a7ada36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:06:55 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-84f36ba2-6d09-48f2-86fa-4eac7f180f26 tempest-GroupsTest-2106406133 None] Created volume successfully.
Sep 07 18:06:55 devstack sudo[96254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_9i68nxk1devstack@QuobyteHD
Sep 07 18:06:55 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:56 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_9i68nxk1devstack@QuobyteHD" returned: 0 in 0.839s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:56 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 was qcow2, converting to qcow2 {{(pid=87269) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 07 18:06:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_9i68nxk1devstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:56 devstack sudo[96277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_9i68nxk1devstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1
Sep 07 18:06:56 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:57 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:06:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Flow 'volume_create_manager' (9ad662a6-da7e-4af1-90b9-148e099494b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:06:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191d7a72-f36b-4114-80d2-79e1d7fecc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191d7a72-f36b-4114-80d2-79e1d7fecc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1744433091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=380ef359-91ea-4631-8c79-a74f7b056b75,host='devstack@QuobyteHD#QuobyteHD',id=7335a4d9-5ee9-44c4-9251-4775f555c715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3270c1f252f24bdd9b0684f625e0e3a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:06:58Z,use_quota=True,user_id='989f60dc45464fd0ade60f2310523084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65513b3c-c7e2-4a30-a168-ac95f6016e0b),volume_type_id=65513b3c-c7e2-4a30-a168-ac95f6016e0b)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515ded8c-1426-44ae-b8b6-8731bc4a949a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515ded8c-1426-44ae-b8b6-8731bc4a949a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0a46ad-8269-466e-842b-426e2fac6f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b0a46ad-8269-466e-842b-426e2fac6f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7335a4d9-5ee9-44c4-9251-4775f555c715', 'volume_name': 'volume-7335a4d9-5ee9-44c4-9251-4775f555c715', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ceba0d5-28e0-4577-9f1a-f5feeaea5bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ceba0d5-28e0-4577-9f1a-f5feeaea5bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2699b08-2df8-450d-adeb-4118ad081345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:58 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Volume 7335a4d9-5ee9-44c4-9251-4775f555c715: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7335a4d9-5ee9-44c4-9251-4775f555c715', 'volume_size': 1}
Sep 07 18:06:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=380ef359-91ea-4631-8c79-a74f7b056b75,created_at=2026-09-07T16:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1744433091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=380ef359-91ea-4631-8c79-a74f7b056b75,host='devstack@QuobyteHD#QuobyteHD',id=7335a4d9-5ee9-44c4-9251-4775f555c715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3270c1f252f24bdd9b0684f625e0e3a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:06:58Z,use_quota=True,user_id='989f60dc45464fd0ade60f2310523084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(65513b3c-c7e2-4a30-a168-ac95f6016e0b),volume_type_id=65513b3c-c7e2-4a30-a168-ac95f6016e0b)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:06:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Creating volume 7335a4d9-5ee9-44c4-9251-4775f555c715 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:06:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:06:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:06:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:06:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:06:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:06:58 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:06:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7335a4d9-5ee9-44c4-9251-4775f555c715 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:58 devstack sudo[96293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7335a4d9-5ee9-44c4-9251-4775f555c715 1073741824
Sep 07 18:06:58 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:59 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7335a4d9-5ee9-44c4-9251-4775f555c715 1073741824" returned: 0 in 0.817s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7335a4d9-5ee9-44c4-9251-4775f555c715 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:59 devstack sudo[96298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7335a4d9-5ee9-44c4-9251-4775f555c715
Sep 07 18:06:59 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:59 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:59 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root
Sep 07 18:06:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_9i68nxk1devstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1" returned: 0 in 3.343s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:59 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_9i68nxk1devstack@QuobyteHD, size 112.00 MB, duration 3.34 sec, destination /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 07 18:06:59 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Converted 112.00 MB image at 33.49 MB/s
Sep 07 18:06:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:06:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7335a4d9-5ee9-44c4-9251-4775f555c715" returned: 0 in 0.625s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:06:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:06:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:06:59 devstack sudo[96301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1 1G
Sep 07 18:06:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2699b08-2df8-450d-adeb-4118ad081345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7335a4d9-5ee9-44c4-9251-4775f555c715', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:59 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:06:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad62250-0abe-4525-b8b0-081bbdd2b9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:06:59 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Volume volume-7335a4d9-5ee9-44c4-9251-4775f555c715 (7335a4d9-5ee9-44c4-9251-4775f555c715): created successfully
Sep 07 18:06:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad62250-0abe-4525-b8b0-081bbdd2b9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:06:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Flow 'volume_create_manager' (9ad662a6-da7e-4af1-90b9-148e099494b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:06:59 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ed91be45-27a6-48a4-bfb6-82fdb3c4426f tempest-GroupsTest-2106406133 None] Created volume successfully.
Sep 07 18:07:00 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1 1G" returned: 0 in 0.505s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:00 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Downloaded image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 ((None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}])) to volume e71ae61d-3fdf-44ef-9ff3-787fdacee2c1 successfully. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 07 18:07:00 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Temporary image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 for user 77466947c3ef4ab4a8b85fe88ded1827 is deleted. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 07 18:07:00 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Marking volume e71ae61d-3fdf-44ef-9ff3-787fdacee2c1 as bootable. {{(pid=87269) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 07 18:07:00 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Copying metadata from image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 to e71ae61d-3fdf-44ef-9ff3-787fdacee2c1. {{(pid=87269) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 07 18:07:00 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Creating volume glance metadata for volume e71ae61d-3fdf-44ef-9ff3-787fdacee2c1 backed by image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87269) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 07 18:07:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7bc14bc-fa3f-4c75-9931-1155d94a09d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1', 'volume_size': 1, 'image_id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72845066d7f346c6b304e9cfe8bcc9a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'created_at': datetime.datetime(2026, 9, 7, 15, 54, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d1601735310>}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:07:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d649a5ee-20bd-4aa0-a16a-3d8d4beeaad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:07:00 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Volume volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1 (e71ae61d-3fdf-44ef-9ff3-787fdacee2c1): created successfully
Sep 07 18:07:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d649a5ee-20bd-4aa0-a16a-3d8d4beeaad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:07:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Flow 'volume_create_manager' (de345707-96d8-4778-b8f5-f04f0f002d34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:07:00 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-07c18786-eeb5-45d4-8942-b2d584e26059 tempest-VolumesExtendTest-309801343 None] Created volume successfully.
Sep 07 18:07:00 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f9bbe34b-1fd6-4ff8-8657-c9bc3ea943ec tempest-GroupsTest-2106406133 None] Update group completed successfully.
Sep 07 18:07:00 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:07:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:07:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:07:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:07:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:07:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:07:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:00 devstack sudo[96308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:07:00 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-362da7a9-84a1-4f7e-b421-bc58d94e9048 tempest-VolumesExtendTest-309801343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:07:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-362da7a9-84a1-4f7e-b421-bc58d94e9048 tempest-VolumesExtendTest-309801343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:07:01 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dab694-19dd-4cc6-b05e-71776a08a7b9]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:07:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-362da7a9-84a1-4f7e-b421-bc58d94e9048 tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:01 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.628s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:07:01 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:07:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 07 18:07:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread info: [<_MainThread(MainThread, started 137533762306176)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137533650971072)>, <Thread(Thread-3 (stat_writer), started daemon 137533647226880)>, <Thread(Rabbit-heartbeat, started daemon 137533647437120)>, <Thread(Thread-5 (_runner), started daemon 137533648120896)>, <Thread(Thread-7 (_runner), started daemon 137533648182592)>, <Thread(fd_logger, started daemon 137533644336576)>, <Thread(privsep_reader, started daemon 137533643255424)>, <Thread(tpool_thread_0, started daemon 137533635446464)>, <Thread(tpool_thread_1, started daemon 137533627053760)>, <Thread(tpool_thread_2, started daemon 137533618661056)>, <Thread(tpool_thread_3, started daemon 137533610251968)>, <Thread(tpool_thread_4, started daemon 137533601842880)>, <Thread(tpool_thread_5, started daemon 137533593433792)>, <Thread(tpool_thread_6, started daemon 137533585024704)>, <Thread(tpool_thread_7, started daemon 137533576615616)>, <Thread(tpool_thread_8, started daemon 137533568206528)>, <Thread(tpool_thread_9, started daemon 137533559797440)>, <Thread(tpool_thread_10, started daemon 137533551388352)>, <Thread(tpool_thread_11, started daemon 137533542979264)>, <Thread(tpool_thread_12, started daemon 137533534570176)>, <Thread(tpool_thread_13, started daemon 137533526161088)>, <Thread(tpool_thread_14, started daemon 137533517752000)>, <Thread(tpool_thread_15, started daemon 137533509342912)>, <Thread(tpool_thread_16, started daemon 137533500933824)>, <Thread(tpool_thread_17, started daemon 137533492524736)>, <Thread(tpool_thread_18, started daemon 137533484115648)>, <Thread(tpool_thread_19, started daemon 137533475706560)>] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 07 18:07:01 devstack sudo[96312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1
Sep 07 18:07:01 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:01 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-362da7a9-84a1-4f7e-b421-bc58d94e9048 tempest-VolumesExtendTest-309801343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1" returned: 0 in 0.576s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-362da7a9-84a1-4f7e-b421-bc58d94e9048 tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1 2G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-362da7a9-84a1-4f7e-b421-bc58d94e9048 tempest-VolumesExtendTest-309801343 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1 2G" returned: 0 in 0.171s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-362da7a9-84a1-4f7e-b421-bc58d94e9048 tempest-VolumesExtendTest-309801343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.801s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:07:02 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-362da7a9-84a1-4f7e-b421-bc58d94e9048 tempest-VolumesExtendTest-309801343 None] Extend volume completed successfully.
Sep 07 18:07:02 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5eb513af-a3c8-462e-9db8-8740f1259f94 tempest-GroupsTest-2106406133 None] Update group completed successfully.
Sep 07 18:07:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-36204ba7-1597-4386-a67f-fdf4a8848489 tempest-VolumesExtendTest-309801343 None] Acquiring lock "cinder-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:07:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-36204ba7-1597-4386-a67f-fdf4a8848489 tempest-VolumesExtendTest-309801343 None] Lock "cinder-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:07:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-36204ba7-1597-4386-a67f-fdf4a8848489 tempest-VolumesExtendTest-309801343 None] Acquiring lock "cinder-quobyte-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:07:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-36204ba7-1597-4386-a67f-fdf4a8848489 tempest-VolumesExtendTest-309801343 None] Lock "cinder-quobyte-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1" acquired by "delete_volume" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:07:03 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[44762f41-4869-477c-be18-fe0454aa38b6]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:07:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-36204ba7-1597-4386-a67f-fdf4a8848489 tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:03 devstack sudo[96358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1
Sep 07 18:07:03 devstack sudo[96358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:03 devstack sudo[96358]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-36204ba7-1597-4386-a67f-fdf4a8848489 tempest-VolumesExtendTest-309801343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1" returned: 0 in 0.412s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-36204ba7-1597-4386-a67f-fdf4a8848489 tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:03 devstack sudo[96365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1
Sep 07 18:07:03 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:03 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-36204ba7-1597-4386-a67f-fdf4a8848489 tempest-VolumesExtendTest-309801343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1" returned: 0 in 0.273s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-36204ba7-1597-4386-a67f-fdf4a8848489 tempest-VolumesExtendTest-309801343 None] Lock "cinder-quobyte-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1" released by "delete_volume" :: held 0.749s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:07:03 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-36204ba7-1597-4386-a67f-fdf4a8848489 tempest-VolumesExtendTest-309801343 None] Created reservations ['1d95d985-409e-465d-8a76-dc8b58b037a2', '64f51fa1-bee0-4db9-b86a-1a52cf93e520', '3476cdb8-d2fc-463f-a248-c4ebb9d3f95a', 'a43e5275-6d64-4fd2-b3da-b87265bbc193'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:07:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-36204ba7-1597-4386-a67f-fdf4a8848489 tempest-VolumesExtendTest-309801343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:07:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-36204ba7-1597-4386-a67f-fdf4a8848489 tempest-VolumesExtendTest-309801343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:07:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-36204ba7-1597-4386-a67f-fdf4a8848489 tempest-VolumesExtendTest-309801343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:07:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-36204ba7-1597-4386-a67f-fdf4a8848489 tempest-VolumesExtendTest-309801343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:07:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-36204ba7-1597-4386-a67f-fdf4a8848489 tempest-VolumesExtendTest-309801343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:07:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-36204ba7-1597-4386-a67f-fdf4a8848489 tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:04 devstack sudo[96368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:07:04 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] Acquiring lock "cinder-quobyte-7335a4d9-5ee9-44c4-9251-4775f555c715" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:07:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] Lock "cinder-quobyte-7335a4d9-5ee9-44c4-9251-4775f555c715" acquired by "delete_volume" :: waited 0.048s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:07:04 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f433a26-1366-477f-b817-5eab1305c323]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:07:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7335a4d9-5ee9-44c4-9251-4775f555c715 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:04 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-36204ba7-1597-4386-a67f-fdf4a8848489 tempest-VolumesExtendTest-309801343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.482s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:04 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-36204ba7-1597-4386-a67f-fdf4a8848489 tempest-VolumesExtendTest-309801343 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:07:04 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-36204ba7-1597-4386-a67f-fdf4a8848489 tempest-VolumesExtendTest-309801343 None] Deleted volume successfully.
Sep 07 18:07:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-36204ba7-1597-4386-a67f-fdf4a8848489 tempest-VolumesExtendTest-309801343 None] Lock "cinder-e71ae61d-3fdf-44ef-9ff3-787fdacee2c1-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:07:04 devstack sudo[96370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7335a4d9-5ee9-44c4-9251-4775f555c715
Sep 07 18:07:04 devstack sudo[96370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:05 devstack sudo[96370]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7335a4d9-5ee9-44c4-9251-4775f555c715" returned: 0 in 0.600s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7335a4d9-5ee9-44c4-9251-4775f555c715 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:07:05 devstack sudo[96376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7335a4d9-5ee9-44c4-9251-4775f555c715
Sep 07 18:07:05 devstack sudo[96376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Flow 'volume_create_manager' (9e49cafa-4ba6-45b8-b4d0-84020aab5878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbde2f10-caf9-4a7e-9f86-8e2d0189a430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbde2f10-caf9-4a7e-9f86-8e2d0189a430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-27787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efa3e053-b9a9-495e-8beb-d04d9b897491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e140b1da1a1a45bf84cd86944a18dd88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:07:05Z,use_quota=True,user_id='77466947c3ef4ab4a8b85fe88ded1827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (748797bf-018b-4f5e-91f7-24397576bdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (748797bf-018b-4f5e-91f7-24397576bdcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74a3bc17-e93b-4198-9772-f436410b444c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74a3bc17-e93b-4198-9772-f436410b444c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efa3e053-b9a9-495e-8beb-d04d9b897491', 'volume_name': 'volume-efa3e053-b9a9-495e-8beb-d04d9b897491', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b498485-bb9c-460d-834f-259d04d59e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b498485-bb9c-460d-834f-259d04d59e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6770d160-d84a-4721-bb30-883722a49a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:07:05 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Volume efa3e053-b9a9-495e-8beb-d04d9b897491: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efa3e053-b9a9-495e-8beb-d04d9b897491', 'volume_size': 1}
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-27787',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efa3e053-b9a9-495e-8beb-d04d9b897491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e140b1da1a1a45bf84cd86944a18dd88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:07:05Z,use_quota=True,user_id='77466947c3ef4ab4a8b85fe88ded1827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Creating volume efa3e053-b9a9-495e-8beb-d04d9b897491 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:07:05 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:05 devstack sudo[96379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491 1073741824
Sep 07 18:07:05 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:05 devstack sudo[96376]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7335a4d9-5ee9-44c4-9251-4775f555c715" returned: 0 in 0.446s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] Lock "cinder-quobyte-7335a4d9-5ee9-44c4-9251-4775f555c715" released by "delete_volume" :: held 1.131s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] Acquiring lock "cinder-quobyte-dea2bddc-41b0-4c36-bbfe-f49040d1d3b5" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] Lock "cinder-quobyte-dea2bddc-41b0-4c36-bbfe-f49040d1d3b5" acquired by "delete_volume" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde02cd5-883b-436b-9a91-05b93fea91af]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-dea2bddc-41b0-4c36-bbfe-f49040d1d3b5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:05 devstack sudo[96385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-dea2bddc-41b0-4c36-bbfe-f49040d1d3b5
Sep 07 18:07:05 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:05 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491 1073741824" returned: 0 in 0.629s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:06 devstack sudo[96389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491
Sep 07 18:07:06 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:06 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-dea2bddc-41b0-4c36-bbfe-f49040d1d3b5" returned: 0 in 0.527s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-dea2bddc-41b0-4c36-bbfe-f49040d1d3b5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:06 devstack sudo[96394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-dea2bddc-41b0-4c36-bbfe-f49040d1d3b5
Sep 07 18:07:06 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:06 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491" returned: 0 in 0.442s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:07:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:07:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6770d160-d84a-4721-bb30-883722a49a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efa3e053-b9a9-495e-8beb-d04d9b897491', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:07:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (795d2538-82e7-41ff-9130-65cc73660904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:07:06 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Volume volume-efa3e053-b9a9-495e-8beb-d04d9b897491 (efa3e053-b9a9-495e-8beb-d04d9b897491): created successfully
Sep 07 18:07:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (795d2538-82e7-41ff-9130-65cc73660904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:07:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Flow 'volume_create_manager' (9e49cafa-4ba6-45b8-b4d0-84020aab5878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:07:06 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9578be53-759e-43ba-ad35-3bd6b06fdbde tempest-VolumesExtendTest-309801343 None] Created volume successfully.
Sep 07 18:07:06 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-dea2bddc-41b0-4c36-bbfe-f49040d1d3b5" returned: 0 in 0.348s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] Lock "cinder-quobyte-dea2bddc-41b0-4c36-bbfe-f49040d1d3b5" released by "delete_volume" :: held 0.935s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:07:06 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] Created reservations ['2429ed93-01f9-42c9-9e0b-32d9367585ed'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:07:06 devstack cinder-volume[87269]: WARNING cinder.quota [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1595095689 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1595095689, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:07:06 devstack cinder-volume[87269]: WARNING cinder.quota [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1595095689 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1595095689, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:07:06 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] Created reservations ['2f254d2a-c596-47fa-9e6a-28fb55ff8be2', 'a4d50d65-23cb-4daa-b995-815aba7b9b6a', '3c76b56d-7950-4d9e-a677-6ce11549741c', 'b0821969-fa7e-46ab-8884-9fbf2cb7aed1'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:07:06 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] Created reservations ['1711b1cf-a992-4925-b84a-b7c5f41fe864', '31c61f3a-e9b0-4e44-a305-5652d0167b1f', '03fc0124-22e3-4148-a16d-b019132cb15a', 'ea3f63c3-537f-4f96-acf7-5c74008703d4'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:07:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:07:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:07:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:07:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:07:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:07:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:06 devstack sudo[96398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:07:06 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:07 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.324s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:07 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:07:07 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0a9a3b5c-00fe-429d-916f-42e90246ec0c tempest-GroupsTest-2106406133 None] Delete group completed successfully.
Sep 07 18:07:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-704dd0b9-b1ff-4779-b96d-3ec178693f3a tempest-VolumesExtendTest-309801343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:07:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-704dd0b9-b1ff-4779-b96d-3ec178693f3a tempest-VolumesExtendTest-309801343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:07:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-704dd0b9-b1ff-4779-b96d-3ec178693f3a tempest-VolumesExtendTest-309801343 None] Creating offline snapshot 22b863d1-35b2-49a8-ae3a-5c2d4ef69931 of volume efa3e053-b9a9-495e-8beb-d04d9b897491 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:07:07 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5776d6-7eb5-4827-a04c-be307049cbbc]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:07:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-704dd0b9-b1ff-4779-b96d-3ec178693f3a tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:07 devstack sudo[96401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491
Sep 07 18:07:07 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:08 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-704dd0b9-b1ff-4779-b96d-3ec178693f3a tempest-VolumesExtendTest-309801343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491" returned: 0 in 0.482s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-704dd0b9-b1ff-4779-b96d-3ec178693f3a tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.22b863d1-35b2-49a8-ae3a-5c2d4ef69931 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:08 devstack sudo[96406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.22b863d1-35b2-49a8-ae3a-5c2d4ef69931 1G
Sep 07 18:07:08 devstack sudo[96406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:08 devstack sudo[96406]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-704dd0b9-b1ff-4779-b96d-3ec178693f3a tempest-VolumesExtendTest-309801343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.22b863d1-35b2-49a8-ae3a-5c2d4ef69931 1G" returned: 0 in 0.570s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-704dd0b9-b1ff-4779-b96d-3ec178693f3a tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efa3e053-b9a9-495e-8beb-d04d9b897491 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.22b863d1-35b2-49a8-ae3a-5c2d4ef69931 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:08 devstack sudo[96412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efa3e053-b9a9-495e-8beb-d04d9b897491 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.22b863d1-35b2-49a8-ae3a-5c2d4ef69931
Sep 07 18:07:08 devstack sudo[96412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:09 devstack sudo[96412]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-704dd0b9-b1ff-4779-b96d-3ec178693f3a tempest-VolumesExtendTest-309801343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-efa3e053-b9a9-495e-8beb-d04d9b897491 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.22b863d1-35b2-49a8-ae3a-5c2d4ef69931" returned: 0 in 0.395s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:09 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-704dd0b9-b1ff-4779-b96d-3ec178693f3a tempest-VolumesExtendTest-309801343 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.22b863d1-35b2-49a8-ae3a-5c2d4ef69931 is being set with open permissions: ugo+rw
Sep 07 18:07:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-704dd0b9-b1ff-4779-b96d-3ec178693f3a tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.22b863d1-35b2-49a8-ae3a-5c2d4ef69931 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:09 devstack sudo[96417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.22b863d1-35b2-49a8-ae3a-5c2d4ef69931
Sep 07 18:07:09 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:09 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-704dd0b9-b1ff-4779-b96d-3ec178693f3a tempest-VolumesExtendTest-309801343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.22b863d1-35b2-49a8-ae3a-5c2d4ef69931" returned: 0 in 0.390s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-704dd0b9-b1ff-4779-b96d-3ec178693f3a tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:09 devstack sudo[96420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.info
Sep 07 18:07:09 devstack sudo[96420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:09 devstack sudo[96420]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-704dd0b9-b1ff-4779-b96d-3ec178693f3a tempest-VolumesExtendTest-309801343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.info" returned: 0 in 0.465s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:09 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-704dd0b9-b1ff-4779-b96d-3ec178693f3a tempest-VolumesExtendTest-309801343 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.info is being set with open permissions: ugo+rw
Sep 07 18:07:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-704dd0b9-b1ff-4779-b96d-3ec178693f3a tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:09 devstack sudo[96423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.info
Sep 07 18:07:09 devstack sudo[96423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:10 devstack sudo[96423]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-704dd0b9-b1ff-4779-b96d-3ec178693f3a tempest-VolumesExtendTest-309801343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.info" returned: 0 in 0.393s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-704dd0b9-b1ff-4779-b96d-3ec178693f3a tempest-VolumesExtendTest-309801343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.836s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:07:10 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-704dd0b9-b1ff-4779-b96d-3ec178693f3a tempest-VolumesExtendTest-309801343 None] Create snapshot completed successfully
Sep 07 18:07:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0285e756-67d8-4d90-81fd-f2f4bbef6c5d tempest-VolumesExtendTest-309801343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:07:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0285e756-67d8-4d90-81fd-f2f4bbef6c5d tempest-VolumesExtendTest-309801343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:07:10 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[454decc6-acd0-4f3c-8959-57fc086be321]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:07:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0285e756-67d8-4d90-81fd-f2f4bbef6c5d tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:11 devstack sudo[96426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491
Sep 07 18:07:11 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:11 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0285e756-67d8-4d90-81fd-f2f4bbef6c5d tempest-VolumesExtendTest-309801343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491" returned: 0 in 0.592s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0285e756-67d8-4d90-81fd-f2f4bbef6c5d tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.22b863d1-35b2-49a8-ae3a-5c2d4ef69931 2G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0285e756-67d8-4d90-81fd-f2f4bbef6c5d tempest-VolumesExtendTest-309801343 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.22b863d1-35b2-49a8-ae3a-5c2d4ef69931 2G" returned: 0 in 0.169s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0285e756-67d8-4d90-81fd-f2f4bbef6c5d tempest-VolumesExtendTest-309801343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.805s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:07:11 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0285e756-67d8-4d90-81fd-f2f4bbef6c5d tempest-VolumesExtendTest-309801343 None] Extend volume completed successfully.
Sep 07 18:07:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-793447be-5c63-4102-874c-6d91133a7f6f tempest-VolumesExtendTest-309801343 None] Acquiring lock "cinder-22b863d1-35b2-49a8-ae3a-5c2d4ef69931-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:07:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-793447be-5c63-4102-874c-6d91133a7f6f tempest-VolumesExtendTest-309801343 None] Lock "cinder-22b863d1-35b2-49a8-ae3a-5c2d4ef69931-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:07:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-793447be-5c63-4102-874c-6d91133a7f6f tempest-VolumesExtendTest-309801343 None] Acquiring lock "cinder-quobyte-efa3e053-b9a9-495e-8beb-d04d9b897491" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:07:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-793447be-5c63-4102-874c-6d91133a7f6f tempest-VolumesExtendTest-309801343 None] Lock "cinder-quobyte-efa3e053-b9a9-495e-8beb-d04d9b897491" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:07:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-793447be-5c63-4102-874c-6d91133a7f6f tempest-VolumesExtendTest-309801343 None] Acquiring lock "cinder-quobyte-22b863d1-35b2-49a8-ae3a-5c2d4ef69931" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:07:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-793447be-5c63-4102-874c-6d91133a7f6f tempest-VolumesExtendTest-309801343 None] Lock "cinder-quobyte-22b863d1-35b2-49a8-ae3a-5c2d4ef69931" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:07:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-793447be-5c63-4102-874c-6d91133a7f6f tempest-VolumesExtendTest-309801343 None] Deleting offline snapshot 22b863d1-35b2-49a8-ae3a-5c2d4ef69931 of volume efa3e053-b9a9-495e-8beb-d04d9b897491 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:07:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-793447be-5c63-4102-874c-6d91133a7f6f tempest-VolumesExtendTest-309801343 None] snapshot_file for this snap is: volume-efa3e053-b9a9-495e-8beb-d04d9b897491.22b863d1-35b2-49a8-ae3a-5c2d4ef69931 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:07:12 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4319e7a9-f458-421e-84e5-ff4ffbdd5542]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:07:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-793447be-5c63-4102-874c-6d91133a7f6f tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.22b863d1-35b2-49a8-ae3a-5c2d4ef69931 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:12 devstack sudo[96439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.22b863d1-35b2-49a8-ae3a-5c2d4ef69931
Sep 07 18:07:12 devstack sudo[96439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:12 devstack sudo[96439]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-793447be-5c63-4102-874c-6d91133a7f6f tempest-VolumesExtendTest-309801343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.22b863d1-35b2-49a8-ae3a-5c2d4ef69931" returned: 0 in 0.567s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-793447be-5c63-4102-874c-6d91133a7f6f tempest-VolumesExtendTest-309801343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-efa3e053-b9a9-495e-8beb-d04d9b897491(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:07:12 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ea6194-7f1b-46ad-ad3a-e6232f72a1a6]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:07:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-793447be-5c63-4102-874c-6d91133a7f6f tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:13 devstack sudo[96445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491
Sep 07 18:07:13 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:13 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-793447be-5c63-4102-874c-6d91133a7f6f tempest-VolumesExtendTest-309801343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491" returned: 0 in 0.639s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-793447be-5c63-4102-874c-6d91133a7f6f tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.22b863d1-35b2-49a8-ae3a-5c2d4ef69931 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:13 devstack sudo[96486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.22b863d1-35b2-49a8-ae3a-5c2d4ef69931
Sep 07 18:07:13 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:14 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-793447be-5c63-4102-874c-6d91133a7f6f tempest-VolumesExtendTest-309801343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.22b863d1-35b2-49a8-ae3a-5c2d4ef69931" returned: 0 in 0.557s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-793447be-5c63-4102-874c-6d91133a7f6f tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.22b863d1-35b2-49a8-ae3a-5c2d4ef69931 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:14 devstack sudo[96492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.22b863d1-35b2-49a8-ae3a-5c2d4ef69931
Sep 07 18:07:14 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:14 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-793447be-5c63-4102-874c-6d91133a7f6f tempest-VolumesExtendTest-309801343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491.22b863d1-35b2-49a8-ae3a-5c2d4ef69931" returned: 0 in 0.363s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-793447be-5c63-4102-874c-6d91133a7f6f tempest-VolumesExtendTest-309801343 None] Lock "cinder-quobyte-22b863d1-35b2-49a8-ae3a-5c2d4ef69931" released by "_delete_snapshot" :: held 2.318s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:07:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-793447be-5c63-4102-874c-6d91133a7f6f tempest-VolumesExtendTest-309801343 None] Lock "cinder-quobyte-efa3e053-b9a9-495e-8beb-d04d9b897491" released by "delete_snapshot" :: held 2.353s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:07:14 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-793447be-5c63-4102-874c-6d91133a7f6f tempest-VolumesExtendTest-309801343 None] Created reservations ['68b1eef8-64ee-4153-8199-90c50d95ed42', '6188e332-e771-40f5-83dd-7ffd22ead817', 'aae21488-7c09-4ec2-bc88-eb71cf8e3d3a', '9131aba1-74b0-4581-a571-c536c2ca782f'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:07:14 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-793447be-5c63-4102-874c-6d91133a7f6f tempest-VolumesExtendTest-309801343 None] Delete snapshot completed successfully.
Sep 07 18:07:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-793447be-5c63-4102-874c-6d91133a7f6f tempest-VolumesExtendTest-309801343 None] Lock "cinder-22b863d1-35b2-49a8-ae3a-5c2d4ef69931-delete_snapshot" released by "delete_snapshot" :: held 2.515s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:07:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-39995055-c3a6-4a7c-a015-de6956ce9ed3 tempest-VolumesExtendTest-309801343 None] Acquiring lock "cinder-efa3e053-b9a9-495e-8beb-d04d9b897491-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:07:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-39995055-c3a6-4a7c-a015-de6956ce9ed3 tempest-VolumesExtendTest-309801343 None] Lock "cinder-efa3e053-b9a9-495e-8beb-d04d9b897491-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:07:15 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=136,cinder:SELECT=115,cinder:DELETE=13,cinder:INSERT=39 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:07:15 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=134,cinder:INSERT=44,cinder:UPDATE=137,cinder:DELETE=5 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:07:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-39995055-c3a6-4a7c-a015-de6956ce9ed3 tempest-VolumesExtendTest-309801343 None] Acquiring lock "cinder-quobyte-efa3e053-b9a9-495e-8beb-d04d9b897491" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:07:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-39995055-c3a6-4a7c-a015-de6956ce9ed3 tempest-VolumesExtendTest-309801343 None] Lock "cinder-quobyte-efa3e053-b9a9-495e-8beb-d04d9b897491" acquired by "delete_volume" :: waited 0.030s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:07:15 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffde89c-56fe-42c5-8a36-095ea22322e0]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:07:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-39995055-c3a6-4a7c-a015-de6956ce9ed3 tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:15 devstack sudo[96495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491
Sep 07 18:07:15 devstack sudo[96495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:16 devstack sudo[96495]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-39995055-c3a6-4a7c-a015-de6956ce9ed3 tempest-VolumesExtendTest-309801343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491" returned: 0 in 0.420s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-39995055-c3a6-4a7c-a015-de6956ce9ed3 tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:16 devstack sudo[96501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491
Sep 07 18:07:16 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:16 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-39995055-c3a6-4a7c-a015-de6956ce9ed3 tempest-VolumesExtendTest-309801343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-efa3e053-b9a9-495e-8beb-d04d9b897491" returned: 0 in 0.279s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-39995055-c3a6-4a7c-a015-de6956ce9ed3 tempest-VolumesExtendTest-309801343 None] Lock "cinder-quobyte-efa3e053-b9a9-495e-8beb-d04d9b897491" released by "delete_volume" :: held 0.789s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:07:16 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-39995055-c3a6-4a7c-a015-de6956ce9ed3 tempest-VolumesExtendTest-309801343 None] Created reservations ['d529dd66-853d-49fd-82e1-c5e549711983', 'b33d3f19-674f-4c66-bd54-48dfaf13def6', '8eab33b1-a7d0-40d5-8fab-e2bed6266cf5', '5d6de13b-8fd8-4d6c-b759-609d376671a3'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:07:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-39995055-c3a6-4a7c-a015-de6956ce9ed3 tempest-VolumesExtendTest-309801343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:07:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-39995055-c3a6-4a7c-a015-de6956ce9ed3 tempest-VolumesExtendTest-309801343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:07:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-39995055-c3a6-4a7c-a015-de6956ce9ed3 tempest-VolumesExtendTest-309801343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:07:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-39995055-c3a6-4a7c-a015-de6956ce9ed3 tempest-VolumesExtendTest-309801343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:07:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-39995055-c3a6-4a7c-a015-de6956ce9ed3 tempest-VolumesExtendTest-309801343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:07:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-39995055-c3a6-4a7c-a015-de6956ce9ed3 tempest-VolumesExtendTest-309801343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:16 devstack sudo[96504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:07:16 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:16 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-39995055-c3a6-4a7c-a015-de6956ce9ed3 tempest-VolumesExtendTest-309801343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.290s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:16 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-39995055-c3a6-4a7c-a015-de6956ce9ed3 tempest-VolumesExtendTest-309801343 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:07:16 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-39995055-c3a6-4a7c-a015-de6956ce9ed3 tempest-VolumesExtendTest-309801343 None] Deleted volume successfully.
Sep 07 18:07:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-39995055-c3a6-4a7c-a015-de6956ce9ed3 tempest-VolumesExtendTest-309801343 None] Lock "cinder-efa3e053-b9a9-495e-8beb-d04d9b897491-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:07:22 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:07:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Flow 'volume_create_manager' (4a0bdf88-0314-444f-978e-3b5cace48e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:07:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb272936-4d79-4946-b7c1-8b3f5a4d8133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:07:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb272936-4d79-4946-b7c1-8b3f5a4d8133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1688854718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c6c908e-cdb7-4652-9b81-113bcdb52061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0fa427ec9d4d50bb071837db245b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:07:22Z,use_quota=True,user_id='9f3f8278b5af47c5aa6c919b4917c0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:07:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45eeac6-dfd6-455a-8acd-848ece9f5c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:07:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a45eeac6-dfd6-455a-8acd-848ece9f5c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:07:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c62965-6370-4432-9ba6-f804719a0649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:07:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c62965-6370-4432-9ba6-f804719a0649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c6c908e-cdb7-4652-9b81-113bcdb52061', 'volume_name': 'volume-5c6c908e-cdb7-4652-9b81-113bcdb52061', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:07:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b98fa20f-bf34-4409-ab8e-e3ec9aeb6149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:07:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b98fa20f-bf34-4409-ab8e-e3ec9aeb6149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:07:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271cac3d-1728-41b0-9447-8105d5d54a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:07:22 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Volume 5c6c908e-cdb7-4652-9b81-113bcdb52061: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c6c908e-cdb7-4652-9b81-113bcdb52061', 'volume_size': 1}
Sep 07 18:07:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:07:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:07:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1688854718',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c6c908e-cdb7-4652-9b81-113bcdb52061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0fa427ec9d4d50bb071837db245b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:07:22Z,use_quota=True,user_id='9f3f8278b5af47c5aa6c919b4917c0c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:07:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Creating volume 5c6c908e-cdb7-4652-9b81-113bcdb52061 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:07:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:07:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:07:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:07:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:07:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:07:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:07:22 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:07:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5c6c908e-cdb7-4652-9b81-113bcdb52061 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:22 devstack sudo[96507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5c6c908e-cdb7-4652-9b81-113bcdb52061 1073741824
Sep 07 18:07:22 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:23 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5c6c908e-cdb7-4652-9b81-113bcdb52061 1073741824" returned: 0 in 0.527s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5c6c908e-cdb7-4652-9b81-113bcdb52061 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:23 devstack sudo[96519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5c6c908e-cdb7-4652-9b81-113bcdb52061
Sep 07 18:07:23 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:23 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5c6c908e-cdb7-4652-9b81-113bcdb52061" returned: 0 in 0.324s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:07:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:07:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (271cac3d-1728-41b0-9447-8105d5d54a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c6c908e-cdb7-4652-9b81-113bcdb52061', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:07:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93268a1-ed33-42bb-bf6f-6fd0c4c03f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:07:23 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Volume volume-5c6c908e-cdb7-4652-9b81-113bcdb52061 (5c6c908e-cdb7-4652-9b81-113bcdb52061): created successfully
Sep 07 18:07:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93268a1-ed33-42bb-bf6f-6fd0c4c03f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:07:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Flow 'volume_create_manager' (4a0bdf88-0314-444f-978e-3b5cace48e1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:07:23 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-34e48240-d3a3-402d-8ee6-d25d4ce56591 tempest-VolumesNegativeTest-1501150298 None] Created volume successfully.
Sep 07 18:07:28 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-8ce2d56f-ffc5-4e84-b8db-0b49ec567b85 req-4b4b10e8-ee4b-475b-bafe-9bcc2c332050 tempest-TestShelveInstance-2081596184 None] Terminate volume connection completed successfully.
Sep 07 18:07:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-8ce2d56f-ffc5-4e84-b8db-0b49ec567b85 req-4b4b10e8-ee4b-475b-bafe-9bcc2c332050 tempest-TestShelveInstance-2081596184 None] Deleting attachment 1c0c3a26-5e06-49fc-b8c7-2b1a4c780910. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 07 18:07:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-2a440539-dfc6-4de5-90e3-d9ca071b4682 req-f9edb0fd-223e-4417-9b77-685152fb6e5a tempest-TestShelveInstance-2081596184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:07:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-2a440539-dfc6-4de5-90e3-d9ca071b4682 req-f9edb0fd-223e-4417-9b77-685152fb6e5a tempest-TestShelveInstance-2081596184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:07:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-2a440539-dfc6-4de5-90e3-d9ca071b4682 req-f9edb0fd-223e-4417-9b77-685152fb6e5a tempest-TestShelveInstance-2081596184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:07:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-2a440539-dfc6-4de5-90e3-d9ca071b4682 req-f9edb0fd-223e-4417-9b77-685152fb6e5a tempest-TestShelveInstance-2081596184 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d', 'name': 'volume-1ce14004-9163-4f09-9f36-cc6816f0a7f4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8163a0a8-d5db-45e6-b927-95f80eee5448', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 07 18:07:33 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-2a440539-dfc6-4de5-90e3-d9ca071b4682 req-f9edb0fd-223e-4417-9b77-685152fb6e5a tempest-TestShelveInstance-2081596184 None] attachment_update completed successfully.
Sep 07 18:07:35 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:07:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Flow 'volume_create_manager' (a7d2924f-e945-437b-9be6-ec5a20f280be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:07:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6325078e-2b2e-488e-80d7-9fc5a5873fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:07:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6325078e-2b2e-488e-80d7-9fc5a5873fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1907137401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d917bac-d2e6-45b5-b325-4bb8a0306944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec4b016d4724bf99db27c094551f2eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:07:35Z,use_quota=True,user_id='f596c97bbcd9425cb6b59842b406f927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7beef341-b6f4-449d-9a22-96b3eeb0975b),volume_type_id=7beef341-b6f4-449d-9a22-96b3eeb0975b)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:07:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3300f7a3-79e4-4cd7-a62d-b6405472c6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:07:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3300f7a3-79e4-4cd7-a62d-b6405472c6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:07:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3506291f-278a-47c2-9a9b-4df15fcdaa1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:07:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3506291f-278a-47c2-9a9b-4df15fcdaa1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d917bac-d2e6-45b5-b325-4bb8a0306944', 'volume_name': 'volume-6d917bac-d2e6-45b5-b325-4bb8a0306944', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:07:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (452f559a-2e1c-43af-a0e4-f3b24b509bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:07:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (452f559a-2e1c-43af-a0e4-f3b24b509bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:07:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f971758e-1332-4526-96ae-cf9c8ce57719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:07:35 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Volume 6d917bac-d2e6-45b5-b325-4bb8a0306944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d917bac-d2e6-45b5-b325-4bb8a0306944', 'volume_size': 1}
Sep 07 18:07:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:07:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:07:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1907137401',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d917bac-d2e6-45b5-b325-4bb8a0306944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec4b016d4724bf99db27c094551f2eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:07:35Z,use_quota=True,user_id='f596c97bbcd9425cb6b59842b406f927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7beef341-b6f4-449d-9a22-96b3eeb0975b),volume_type_id=7beef341-b6f4-449d-9a22-96b3eeb0975b)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:07:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Creating volume 6d917bac-d2e6-45b5-b325-4bb8a0306944 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:07:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:07:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:07:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:07:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:07:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:07:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:07:35 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:07:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6d917bac-d2e6-45b5-b325-4bb8a0306944 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:35 devstack sudo[96674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6d917bac-d2e6-45b5-b325-4bb8a0306944 1073741824
Sep 07 18:07:35 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:36 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6d917bac-d2e6-45b5-b325-4bb8a0306944 1073741824" returned: 0 in 1.179s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6d917bac-d2e6-45b5-b325-4bb8a0306944 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:36 devstack sudo[96736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6d917bac-d2e6-45b5-b325-4bb8a0306944
Sep 07 18:07:36 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:37 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6d917bac-d2e6-45b5-b325-4bb8a0306944" returned: 0 in 0.626s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:07:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.942s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:07:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f971758e-1332-4526-96ae-cf9c8ce57719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d917bac-d2e6-45b5-b325-4bb8a0306944', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:07:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c9e714-13a6-42b8-bcf1-9b8deaa4edbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:07:37 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Volume volume-6d917bac-d2e6-45b5-b325-4bb8a0306944 (6d917bac-d2e6-45b5-b325-4bb8a0306944): created successfully
Sep 07 18:07:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c9e714-13a6-42b8-bcf1-9b8deaa4edbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:07:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Flow 'volume_create_manager' (a7d2924f-e945-437b-9be6-ec5a20f280be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:07:37 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-644d6175-0d4e-4bd2-ab74-7b307484c2f3 tempest-VolumeTypesAccessTest-633778126 None] Created volume successfully.
Sep 07 18:07:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bf5ebd9f-a640-4447-b3a6-b68a0a600e14 tempest-VolumeTypesAccessTest-633778126 None] Acquiring lock "cinder-6d917bac-d2e6-45b5-b325-4bb8a0306944-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:07:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bf5ebd9f-a640-4447-b3a6-b68a0a600e14 tempest-VolumeTypesAccessTest-633778126 None] Lock "cinder-6d917bac-d2e6-45b5-b325-4bb8a0306944-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:07:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bf5ebd9f-a640-4447-b3a6-b68a0a600e14 tempest-VolumeTypesAccessTest-633778126 None] Acquiring lock "cinder-quobyte-6d917bac-d2e6-45b5-b325-4bb8a0306944" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:07:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bf5ebd9f-a640-4447-b3a6-b68a0a600e14 tempest-VolumeTypesAccessTest-633778126 None] Lock "cinder-quobyte-6d917bac-d2e6-45b5-b325-4bb8a0306944" acquired by "delete_volume" :: waited 0.050s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:07:39 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd7ea30-6788-4e3c-b717-0b1b90f10d70]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:07:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bf5ebd9f-a640-4447-b3a6-b68a0a600e14 tempest-VolumeTypesAccessTest-633778126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6d917bac-d2e6-45b5-b325-4bb8a0306944 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:39 devstack sudo[96749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6d917bac-d2e6-45b5-b325-4bb8a0306944
Sep 07 18:07:39 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:39 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bf5ebd9f-a640-4447-b3a6-b68a0a600e14 tempest-VolumeTypesAccessTest-633778126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6d917bac-d2e6-45b5-b325-4bb8a0306944" returned: 0 in 0.589s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bf5ebd9f-a640-4447-b3a6-b68a0a600e14 tempest-VolumeTypesAccessTest-633778126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6d917bac-d2e6-45b5-b325-4bb8a0306944 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:39 devstack sudo[96759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6d917bac-d2e6-45b5-b325-4bb8a0306944
Sep 07 18:07:39 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:40 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bf5ebd9f-a640-4447-b3a6-b68a0a600e14 tempest-VolumeTypesAccessTest-633778126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6d917bac-d2e6-45b5-b325-4bb8a0306944" returned: 0 in 0.574s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bf5ebd9f-a640-4447-b3a6-b68a0a600e14 tempest-VolumeTypesAccessTest-633778126 None] Lock "cinder-quobyte-6d917bac-d2e6-45b5-b325-4bb8a0306944" released by "delete_volume" :: held 1.250s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:07:40 devstack cinder-volume[87269]: WARNING cinder.quota [None req-bf5ebd9f-a640-4447-b3a6-b68a0a600e14 tempest-VolumeTypesAccessTest-633778126 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-867656344 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-867656344, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:07:40 devstack cinder-volume[87269]: WARNING cinder.quota [None req-bf5ebd9f-a640-4447-b3a6-b68a0a600e14 tempest-VolumeTypesAccessTest-633778126 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-867656344 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-867656344, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:07:40 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-bf5ebd9f-a640-4447-b3a6-b68a0a600e14 tempest-VolumeTypesAccessTest-633778126 None] Created reservations ['6799b75e-641f-4d7f-8237-e25deea04384', 'f850defa-702f-4aee-ac3f-760c1136b875', '1c185a9c-9701-4c9d-b913-7018853db3cd', 'd7ed3dc1-7946-4f82-868d-cf30f7e0718a'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:07:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bf5ebd9f-a640-4447-b3a6-b68a0a600e14 tempest-VolumeTypesAccessTest-633778126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:07:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bf5ebd9f-a640-4447-b3a6-b68a0a600e14 tempest-VolumeTypesAccessTest-633778126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:07:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bf5ebd9f-a640-4447-b3a6-b68a0a600e14 tempest-VolumeTypesAccessTest-633778126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:07:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bf5ebd9f-a640-4447-b3a6-b68a0a600e14 tempest-VolumeTypesAccessTest-633778126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:07:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bf5ebd9f-a640-4447-b3a6-b68a0a600e14 tempest-VolumeTypesAccessTest-633778126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:07:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bf5ebd9f-a640-4447-b3a6-b68a0a600e14 tempest-VolumeTypesAccessTest-633778126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:40 devstack sudo[96778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:07:40 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:40 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bf5ebd9f-a640-4447-b3a6-b68a0a600e14 tempest-VolumeTypesAccessTest-633778126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.366s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:40 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-bf5ebd9f-a640-4447-b3a6-b68a0a600e14 tempest-VolumeTypesAccessTest-633778126 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:07:40 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-bf5ebd9f-a640-4447-b3a6-b68a0a600e14 tempest-VolumeTypesAccessTest-633778126 None] Deleted volume successfully.
Sep 07 18:07:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bf5ebd9f-a640-4447-b3a6-b68a0a600e14 tempest-VolumeTypesAccessTest-633778126 None] Lock "cinder-6d917bac-d2e6-45b5-b325-4bb8a0306944-delete_volume" released by "delete_volume" :: held 2.051s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:07:50 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=25,cinder:INSERT=6,cinder:UPDATE=21,cinder:DELETE=2 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:07:50 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=17,cinder:INSERT=4,cinder:UPDATE=25,cinder:DELETE=2 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:07:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-58c4ca9b-9bda-4135-b5de-e2f47e378fe6 tempest-VolumesNegativeTest-1501150298 None] Acquiring lock "cinder-5c6c908e-cdb7-4652-9b81-113bcdb52061-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:07:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-58c4ca9b-9bda-4135-b5de-e2f47e378fe6 tempest-VolumesNegativeTest-1501150298 None] Lock "cinder-5c6c908e-cdb7-4652-9b81-113bcdb52061-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:07:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-58c4ca9b-9bda-4135-b5de-e2f47e378fe6 tempest-VolumesNegativeTest-1501150298 None] Acquiring lock "cinder-quobyte-5c6c908e-cdb7-4652-9b81-113bcdb52061" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:07:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-58c4ca9b-9bda-4135-b5de-e2f47e378fe6 tempest-VolumesNegativeTest-1501150298 None] Lock "cinder-quobyte-5c6c908e-cdb7-4652-9b81-113bcdb52061" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:07:54 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c605f4a4-2abf-4c96-9dc3-12f2f2d395a2]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:07:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58c4ca9b-9bda-4135-b5de-e2f47e378fe6 tempest-VolumesNegativeTest-1501150298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5c6c908e-cdb7-4652-9b81-113bcdb52061 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:54 devstack sudo[97265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5c6c908e-cdb7-4652-9b81-113bcdb52061
Sep 07 18:07:54 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:54 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58c4ca9b-9bda-4135-b5de-e2f47e378fe6 tempest-VolumesNegativeTest-1501150298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5c6c908e-cdb7-4652-9b81-113bcdb52061" returned: 0 in 0.399s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58c4ca9b-9bda-4135-b5de-e2f47e378fe6 tempest-VolumesNegativeTest-1501150298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5c6c908e-cdb7-4652-9b81-113bcdb52061 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:54 devstack sudo[97270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5c6c908e-cdb7-4652-9b81-113bcdb52061
Sep 07 18:07:54 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:55 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58c4ca9b-9bda-4135-b5de-e2f47e378fe6 tempest-VolumesNegativeTest-1501150298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5c6c908e-cdb7-4652-9b81-113bcdb52061" returned: 0 in 0.276s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-58c4ca9b-9bda-4135-b5de-e2f47e378fe6 tempest-VolumesNegativeTest-1501150298 None] Lock "cinder-quobyte-5c6c908e-cdb7-4652-9b81-113bcdb52061" released by "delete_volume" :: held 0.723s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:07:55 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-58c4ca9b-9bda-4135-b5de-e2f47e378fe6 tempest-VolumesNegativeTest-1501150298 None] Created reservations ['5019903d-905c-4c1c-b4a9-f3915de2e0a0', 'bc72aa49-01c2-4fdb-a42f-c8c5bc58b170', '7c18fbf6-4649-4afb-a9b3-a14597b43635', '693563e0-998b-4eed-b188-d0292b09b0f4'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:07:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-58c4ca9b-9bda-4135-b5de-e2f47e378fe6 tempest-VolumesNegativeTest-1501150298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:07:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-58c4ca9b-9bda-4135-b5de-e2f47e378fe6 tempest-VolumesNegativeTest-1501150298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:07:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-58c4ca9b-9bda-4135-b5de-e2f47e378fe6 tempest-VolumesNegativeTest-1501150298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:07:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-58c4ca9b-9bda-4135-b5de-e2f47e378fe6 tempest-VolumesNegativeTest-1501150298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:07:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-58c4ca9b-9bda-4135-b5de-e2f47e378fe6 tempest-VolumesNegativeTest-1501150298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:07:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58c4ca9b-9bda-4135-b5de-e2f47e378fe6 tempest-VolumesNegativeTest-1501150298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:55 devstack sudo[97273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:07:55 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:07:55 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root
Sep 07 18:07:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58c4ca9b-9bda-4135-b5de-e2f47e378fe6 tempest-VolumesNegativeTest-1501150298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.299s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:07:55 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-58c4ca9b-9bda-4135-b5de-e2f47e378fe6 tempest-VolumesNegativeTest-1501150298 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:07:55 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-58c4ca9b-9bda-4135-b5de-e2f47e378fe6 tempest-VolumesNegativeTest-1501150298 None] Deleted volume successfully.
Sep 07 18:07:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-58c4ca9b-9bda-4135-b5de-e2f47e378fe6 tempest-VolumesNegativeTest-1501150298 None] Lock "cinder-5c6c908e-cdb7-4652-9b81-113bcdb52061-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:07:59 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:07:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Flow 'volume_create_manager' (313038cb-71a5-4208-9171-814b23d754a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:07:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c01f3d-0c95-42ed-a76e-0c953fc5f03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:07:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c01f3d-0c95-42ed-a76e-0c953fc5f03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1814531778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb06df5-e979-4227-8f17-042b700ba21a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a60f539ff7674db29665ba1e5f489029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:08:00Z,use_quota=True,user_id='332a31d1e5de42df971f3f7c47ed59be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:07:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (842d58da-aaea-4fa0-8407-11cfa0e7ed7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:07:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (842d58da-aaea-4fa0-8407-11cfa0e7ed7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:07:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd731f5-4d36-4a98-805a-202312cb434b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:07:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd731f5-4d36-4a98-805a-202312cb434b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beb06df5-e979-4227-8f17-042b700ba21a', 'volume_name': 'volume-beb06df5-e979-4227-8f17-042b700ba21a', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:07:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f02f5942-6ef4-4e0d-9193-f98a27d91743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:07:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f02f5942-6ef4-4e0d-9193-f98a27d91743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:07:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cf8f11-3f8d-4297-a8a3-3dceb1a1c6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:07:59 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Volume beb06df5-e979-4227-8f17-042b700ba21a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beb06df5-e979-4227-8f17-042b700ba21a', 'volume_size': 1}
Sep 07 18:07:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:07:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:07:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1814531778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb06df5-e979-4227-8f17-042b700ba21a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a60f539ff7674db29665ba1e5f489029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:08:00Z,use_quota=True,user_id='332a31d1e5de42df971f3f7c47ed59be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:07:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Creating volume beb06df5-e979-4227-8f17-042b700ba21a {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:07:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:07:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:07:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:07:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:07:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:07:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:07:59 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:07:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:07:59 devstack sudo[97277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a 1073741824
Sep 07 18:07:59 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:00 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a 1073741824" returned: 0 in 0.478s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:00 devstack sudo[97283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a
Sep 07 18:08:00 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:00 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:08:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:08:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:08:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:08:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:08:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:00 devstack sudo[97285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:08:00 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:00 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a" returned: 0 in 0.512s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:08:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cf8f11-3f8d-4297-a8a3-3dceb1a1c6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beb06df5-e979-4227-8f17-042b700ba21a', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a7da399-3100-4bb8-b6e8-0600fa997c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:01 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Volume volume-beb06df5-e979-4227-8f17-042b700ba21a (beb06df5-e979-4227-8f17-042b700ba21a): created successfully
Sep 07 18:08:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a7da399-3100-4bb8-b6e8-0600fa997c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Flow 'volume_create_manager' (313038cb-71a5-4208-9171-814b23d754a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:08:01 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-99af4220-8be2-4dda-83a5-a4b8a97de134 tempest-VolumesSnapshotListTestJSON-1889061291 None] Created volume successfully.
Sep 07 18:08:01 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.452s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:08:01 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:08:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 07 18:08:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread info: [<_MainThread(MainThread, started 137533762306176)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137533650971072)>, <Thread(Thread-3 (stat_writer), started daemon 137533647226880)>, <Thread(Rabbit-heartbeat, started daemon 137533647437120)>, <Thread(Thread-5 (_runner), started daemon 137533648120896)>, <Thread(Thread-7 (_runner), started daemon 137533648182592)>, <Thread(fd_logger, started daemon 137533644336576)>, <Thread(privsep_reader, started daemon 137533643255424)>, <Thread(tpool_thread_0, started daemon 137533635446464)>, <Thread(tpool_thread_1, started daemon 137533627053760)>, <Thread(tpool_thread_2, started daemon 137533618661056)>, <Thread(tpool_thread_3, started daemon 137533610251968)>, <Thread(tpool_thread_4, started daemon 137533601842880)>, <Thread(tpool_thread_5, started daemon 137533593433792)>, <Thread(tpool_thread_6, started daemon 137533585024704)>, <Thread(tpool_thread_7, started daemon 137533576615616)>, <Thread(tpool_thread_8, started daemon 137533568206528)>, <Thread(tpool_thread_9, started daemon 137533559797440)>, <Thread(tpool_thread_10, started daemon 137533551388352)>, <Thread(tpool_thread_11, started daemon 137533542979264)>, <Thread(tpool_thread_12, started daemon 137533534570176)>, <Thread(tpool_thread_13, started daemon 137533526161088)>, <Thread(tpool_thread_14, started daemon 137533517752000)>, <Thread(tpool_thread_15, started daemon 137533509342912)>, <Thread(tpool_thread_16, started daemon 137533500933824)>, <Thread(tpool_thread_17, started daemon 137533492524736)>, <Thread(tpool_thread_18, started daemon 137533484115648)>, <Thread(tpool_thread_19, started daemon 137533475706560)>] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 07 18:08:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-961327ed-2107-4f34-8c8c-6a9e7980bc11 tempest-VolumesSnapshotListTestJSON-1889061291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:08:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-961327ed-2107-4f34-8c8c-6a9e7980bc11 tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:08:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-961327ed-2107-4f34-8c8c-6a9e7980bc11 tempest-VolumesSnapshotListTestJSON-1889061291 None] Creating offline snapshot f7ce9bf6-0144-4a3d-be23-7adab1776cea of volume beb06df5-e979-4227-8f17-042b700ba21a {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:08:02 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[374e91eb-3d70-4262-b4cf-86b8efa37282]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:08:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-961327ed-2107-4f34-8c8c-6a9e7980bc11 tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:02 devstack sudo[97327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a
Sep 07 18:08:02 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:02 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-961327ed-2107-4f34-8c8c-6a9e7980bc11 tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a" returned: 0 in 0.401s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-961327ed-2107-4f34-8c8c-6a9e7980bc11 tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:02 devstack sudo[97333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea 1G
Sep 07 18:08:02 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:02 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-961327ed-2107-4f34-8c8c-6a9e7980bc11 tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea 1G" returned: 0 in 0.443s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-961327ed-2107-4f34-8c8c-6a9e7980bc11 tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beb06df5-e979-4227-8f17-042b700ba21a -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:02 devstack sudo[97339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beb06df5-e979-4227-8f17-042b700ba21a -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea
Sep 07 18:08:02 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:03 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-961327ed-2107-4f34-8c8c-6a9e7980bc11 tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beb06df5-e979-4227-8f17-042b700ba21a -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea" returned: 0 in 0.334s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:03 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-961327ed-2107-4f34-8c8c-6a9e7980bc11 tempest-VolumesSnapshotListTestJSON-1889061291 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea is being set with open permissions: ugo+rw
Sep 07 18:08:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-961327ed-2107-4f34-8c8c-6a9e7980bc11 tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:03 devstack sudo[97345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea
Sep 07 18:08:03 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:03 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-961327ed-2107-4f34-8c8c-6a9e7980bc11 tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea" returned: 0 in 0.284s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-961327ed-2107-4f34-8c8c-6a9e7980bc11 tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:03 devstack sudo[97382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.info
Sep 07 18:08:03 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:03 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-961327ed-2107-4f34-8c8c-6a9e7980bc11 tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.info" returned: 0 in 0.280s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:03 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-961327ed-2107-4f34-8c8c-6a9e7980bc11 tempest-VolumesSnapshotListTestJSON-1889061291 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.info is being set with open permissions: ugo+rw
Sep 07 18:08:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-961327ed-2107-4f34-8c8c-6a9e7980bc11 tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:03 devstack sudo[97387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.info
Sep 07 18:08:03 devstack sudo[97387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:04 devstack sudo[97387]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-961327ed-2107-4f34-8c8c-6a9e7980bc11 tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.info" returned: 0 in 0.266s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-961327ed-2107-4f34-8c8c-6a9e7980bc11 tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.113s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:04 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-961327ed-2107-4f34-8c8c-6a9e7980bc11 tempest-VolumesSnapshotListTestJSON-1889061291 None] Create snapshot completed successfully
Sep 07 18:08:04 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:08:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Flow 'volume_create_manager' (01c35b5b-2b8e-429b-8912-0b10543ba0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:08:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f676246-8c52-465d-a63d-3509e6e28ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f676246-8c52-465d-a63d-3509e6e28ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-899739845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ccc33a0-db77-4d67-a700-0f2ac8e127ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c6445e4479a4f25bcce2536b55b37f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:08:05Z,use_quota=True,user_id='06f038df90f74342888199086c12f09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (556cefd3-3f36-459a-884a-fa3f20db381c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (556cefd3-3f36-459a-884a-fa3f20db381c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55600083-ead8-4b10-9ad0-47a94e592fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55600083-ead8-4b10-9ad0-47a94e592fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ccc33a0-db77-4d67-a700-0f2ac8e127ec', 'volume_name': 'volume-5ccc33a0-db77-4d67-a700-0f2ac8e127ec', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc184bc9-483a-4113-bdb7-8ee39d75f8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc184bc9-483a-4113-bdb7-8ee39d75f8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d163587-7ac4-4d63-80b5-d9a54f2c29b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:04 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Volume 5ccc33a0-db77-4d67-a700-0f2ac8e127ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ccc33a0-db77-4d67-a700-0f2ac8e127ec', 'volume_size': 1}
Sep 07 18:08:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:08:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:08:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-899739845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ccc33a0-db77-4d67-a700-0f2ac8e127ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c6445e4479a4f25bcce2536b55b37f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:08:05Z,use_quota=True,user_id='06f038df90f74342888199086c12f09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:08:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Creating volume 5ccc33a0-db77-4d67-a700-0f2ac8e127ec {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:08:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:08:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:08:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:08:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:08:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:08:04 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:08:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5ccc33a0-db77-4d67-a700-0f2ac8e127ec 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:04 devstack sudo[97392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5ccc33a0-db77-4d67-a700-0f2ac8e127ec 1073741824
Sep 07 18:08:04 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:05 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5ccc33a0-db77-4d67-a700-0f2ac8e127ec 1073741824" returned: 0 in 0.461s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5ccc33a0-db77-4d67-a700-0f2ac8e127ec {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-65d4dcfa-ecd1-4998-8dc4-383ff7c48391 tempest-VolumesSnapshotListTestJSON-1889061291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:08:05 devstack sudo[97398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5ccc33a0-db77-4d67-a700-0f2ac8e127ec
Sep 07 18:08:05 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:05 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5ccc33a0-db77-4d67-a700-0f2ac8e127ec" returned: 0 in 0.269s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:08:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-65d4dcfa-ecd1-4998-8dc4-383ff7c48391 tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.243s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:08:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-65d4dcfa-ecd1-4998-8dc4-383ff7c48391 tempest-VolumesSnapshotListTestJSON-1889061291 None] Creating offline snapshot a70b772a-b2b7-4db8-90ed-219b89ba52ae of volume beb06df5-e979-4227-8f17-042b700ba21a {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:08:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d163587-7ac4-4d63-80b5-d9a54f2c29b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ccc33a0-db77-4d67-a700-0f2ac8e127ec', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e4abf7-7a8f-47d6-864f-a430debec81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:05 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[754a18de-6a52-4d6e-a5c5-5ccb7c81e171]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:08:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-65d4dcfa-ecd1-4998-8dc4-383ff7c48391 tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:05 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Volume volume-5ccc33a0-db77-4d67-a700-0f2ac8e127ec (5ccc33a0-db77-4d67-a700-0f2ac8e127ec): created successfully
Sep 07 18:08:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e4abf7-7a8f-47d6-864f-a430debec81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Flow 'volume_create_manager' (01c35b5b-2b8e-429b-8912-0b10543ba0e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:08:05 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a57b475d-f73b-4028-80cf-185d723dfc27 tempest-AttachVolumeNegativeTest-1258960963 None] Created volume successfully.
Sep 07 18:08:05 devstack sudo[97401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea
Sep 07 18:08:05 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:06 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-65d4dcfa-ecd1-4998-8dc4-383ff7c48391 tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea" returned: 0 in 0.400s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-65d4dcfa-ecd1-4998-8dc4-383ff7c48391 tempest-VolumesSnapshotListTestJSON-1889061291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beb06df5-e979-4227-8f17-042b700ba21a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:08:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-65d4dcfa-ecd1-4998-8dc4-383ff7c48391 tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:06 devstack sudo[97407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae 1G
Sep 07 18:08:06 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:06 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-65d4dcfa-ecd1-4998-8dc4-383ff7c48391 tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae 1G" returned: 0 in 0.434s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-65d4dcfa-ecd1-4998-8dc4-383ff7c48391 tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:06 devstack sudo[97413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae
Sep 07 18:08:06 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:06 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-65d4dcfa-ecd1-4998-8dc4-383ff7c48391 tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae" returned: 0 in 0.325s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:06 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-65d4dcfa-ecd1-4998-8dc4-383ff7c48391 tempest-VolumesSnapshotListTestJSON-1889061291 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae is being set with open permissions: ugo+rw
Sep 07 18:08:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-65d4dcfa-ecd1-4998-8dc4-383ff7c48391 tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:06 devstack sudo[97418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae
Sep 07 18:08:06 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:07 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-65d4dcfa-ecd1-4998-8dc4-383ff7c48391 tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae" returned: 0 in 0.275s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-65d4dcfa-ecd1-4998-8dc4-383ff7c48391 tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.569s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:07 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-65d4dcfa-ecd1-4998-8dc4-383ff7c48391 tempest-VolumesSnapshotListTestJSON-1889061291 None] Create snapshot completed successfully
Sep 07 18:08:07 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:08:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Flow 'volume_create_manager' (f168c364-8f28-4d06-a050-34f27d8a9da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:08:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (455113e1-636b-4941-92e5-2453f05ffc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (455113e1-636b-4941-92e5-2453f05ffc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-73624254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53eea1a9-9a6f-456f-8424-5d5aab5077ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59968babfef34f5a8e1fe447402afc0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:08:07Z,use_quota=True,user_id='22637218d0f042b28640a1f2a812731c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b16dd11-73b6-496b-bc3a-e843db206c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b16dd11-73b6-496b-bc3a-e843db206c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ccdc9c-811d-44ce-8d69-df4a2aa3ce56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ccdc9c-811d-44ce-8d69-df4a2aa3ce56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53eea1a9-9a6f-456f-8424-5d5aab5077ee', 'volume_name': 'volume-53eea1a9-9a6f-456f-8424-5d5aab5077ee', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94eefa50-c460-4732-bdaf-5d8bba11a5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94eefa50-c460-4732-bdaf-5d8bba11a5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31671f12-afca-4963-a45c-ca3f8c455572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:07 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Volume 53eea1a9-9a6f-456f-8424-5d5aab5077ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53eea1a9-9a6f-456f-8424-5d5aab5077ee', 'volume_size': 1}
Sep 07 18:08:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:08:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:08:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-73624254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53eea1a9-9a6f-456f-8424-5d5aab5077ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59968babfef34f5a8e1fe447402afc0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:08:07Z,use_quota=True,user_id='22637218d0f042b28640a1f2a812731c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:08:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Creating volume 53eea1a9-9a6f-456f-8424-5d5aab5077ee {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:08:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:08:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:08:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:08:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:08:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:08:07 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:08:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-53eea1a9-9a6f-456f-8424-5d5aab5077ee 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:07 devstack sudo[97431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-53eea1a9-9a6f-456f-8424-5d5aab5077ee 1073741824
Sep 07 18:08:07 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-76cb166b-4da4-461d-b8bf-90f7db1276f5 tempest-VolumesSnapshotListTestJSON-1889061291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:08:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-3a7aedc1-ba0f-4d94-a191-e997be8f0cc6 req-7c22ea3c-ae40-419d-8e57-ba493c31e99c tempest-AttachVolumeNegativeTest-1258960963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:08:08 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-53eea1a9-9a6f-456f-8424-5d5aab5077ee 1073741824" returned: 0 in 0.446s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-53eea1a9-9a6f-456f-8424-5d5aab5077ee {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:08 devstack sudo[97437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-53eea1a9-9a6f-456f-8424-5d5aab5077ee
Sep 07 18:08:08 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:08 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-53eea1a9-9a6f-456f-8424-5d5aab5077ee" returned: 0 in 0.240s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:08:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-76cb166b-4da4-461d-b8bf-90f7db1276f5 tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.637s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:08:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31671f12-afca-4963-a45c-ca3f8c455572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53eea1a9-9a6f-456f-8424-5d5aab5077ee', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae7c44a-ef33-4416-9899-216ea5964fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-76cb166b-4da4-461d-b8bf-90f7db1276f5 tempest-VolumesSnapshotListTestJSON-1889061291 None] Creating offline snapshot acaddc12-f575-4c90-9a28-c8bb799fbf40 of volume beb06df5-e979-4227-8f17-042b700ba21a {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:08:08 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Volume volume-53eea1a9-9a6f-456f-8424-5d5aab5077ee (53eea1a9-9a6f-456f-8424-5d5aab5077ee): created successfully
Sep 07 18:08:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ae7c44a-ef33-4416-9899-216ea5964fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Flow 'volume_create_manager' (f168c364-8f28-4d06-a050-34f27d8a9da9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:08:08 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b6dabe-e2df-4a92-a04f-54e766487307]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:08:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-76cb166b-4da4-461d-b8bf-90f7db1276f5 tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:08 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-14e220bb-5e27-45ff-bd54-d7a19e675b8b tempest-VolumesListAdminTestJSON-1448364767 None] Created volume successfully.
Sep 07 18:08:08 devstack sudo[97440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae
Sep 07 18:08:08 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:08 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-76cb166b-4da4-461d-b8bf-90f7db1276f5 tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae" returned: 0 in 0.364s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-76cb166b-4da4-461d-b8bf-90f7db1276f5 tempest-VolumesSnapshotListTestJSON-1889061291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beb06df5-e979-4227-8f17-042b700ba21a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:08:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-76cb166b-4da4-461d-b8bf-90f7db1276f5 tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.acaddc12-f575-4c90-9a28-c8bb799fbf40 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:08 devstack sudo[97445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.acaddc12-f575-4c90-9a28-c8bb799fbf40 1G
Sep 07 18:08:08 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:09 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-76cb166b-4da4-461d-b8bf-90f7db1276f5 tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.acaddc12-f575-4c90-9a28-c8bb799fbf40 1G" returned: 0 in 0.448s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-76cb166b-4da4-461d-b8bf-90f7db1276f5 tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.acaddc12-f575-4c90-9a28-c8bb799fbf40 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:09 devstack sudo[97450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.acaddc12-f575-4c90-9a28-c8bb799fbf40
Sep 07 18:08:09 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:09 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-76cb166b-4da4-461d-b8bf-90f7db1276f5 tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.acaddc12-f575-4c90-9a28-c8bb799fbf40" returned: 0 in 0.316s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:09 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-76cb166b-4da4-461d-b8bf-90f7db1276f5 tempest-VolumesSnapshotListTestJSON-1889061291 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.acaddc12-f575-4c90-9a28-c8bb799fbf40 is being set with open permissions: ugo+rw
Sep 07 18:08:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-76cb166b-4da4-461d-b8bf-90f7db1276f5 tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.acaddc12-f575-4c90-9a28-c8bb799fbf40 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:09 devstack sudo[97455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.acaddc12-f575-4c90-9a28-c8bb799fbf40
Sep 07 18:08:09 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:09 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-76cb166b-4da4-461d-b8bf-90f7db1276f5 tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.acaddc12-f575-4c90-9a28-c8bb799fbf40" returned: 0 in 0.274s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-76cb166b-4da4-461d-b8bf-90f7db1276f5 tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.538s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-3a7aedc1-ba0f-4d94-a191-e997be8f0cc6 req-7c22ea3c-ae40-419d-8e57-ba493c31e99c tempest-AttachVolumeNegativeTest-1258960963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.109s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:08:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-3a7aedc1-ba0f-4d94-a191-e997be8f0cc6 req-7c22ea3c-ae40-419d-8e57-ba493c31e99c tempest-AttachVolumeNegativeTest-1258960963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:09 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-76cb166b-4da4-461d-b8bf-90f7db1276f5 tempest-VolumesSnapshotListTestJSON-1889061291 None] Create snapshot completed successfully
Sep 07 18:08:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-3a7aedc1-ba0f-4d94-a191-e997be8f0cc6 req-7c22ea3c-ae40-419d-8e57-ba493c31e99c tempest-AttachVolumeNegativeTest-1258960963 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d', 'name': 'volume-5ccc33a0-db77-4d67-a700-0f2ac8e127ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6e4ecdc1-f4cf-40d8-a36f-b219e20aa193', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 07 18:08:10 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-3a7aedc1-ba0f-4d94-a191-e997be8f0cc6 req-7c22ea3c-ae40-419d-8e57-ba493c31e99c tempest-AttachVolumeNegativeTest-1258960963 None] attachment_update completed successfully.
Sep 07 18:08:10 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:08:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Flow 'volume_create_manager' (b1288900-fb4c-4aac-ae0d-d0eefc5d9ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:08:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (876550ac-b26a-4a17-9c8b-e528cf9eacb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (876550ac-b26a-4a17-9c8b-e528cf9eacb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1705704355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2586a79b-5979-4021-9bfc-038fe8d34b02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59968babfef34f5a8e1fe447402afc0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:08:10Z,use_quota=True,user_id='22637218d0f042b28640a1f2a812731c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944bcdf9-3ec6-4b9c-9560-024668036e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (944bcdf9-3ec6-4b9c-9560-024668036e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba21a4b-7eb4-49e8-bce7-ad3881d155d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba21a4b-7eb4-49e8-bce7-ad3881d155d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2586a79b-5979-4021-9bfc-038fe8d34b02', 'volume_name': 'volume-2586a79b-5979-4021-9bfc-038fe8d34b02', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d47c57a2-9b4c-4e37-9e9c-5bbb9be1748f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d47c57a2-9b4c-4e37-9e9c-5bbb9be1748f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca50757-b183-4067-9e52-ed820fbdf2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:10 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Volume 2586a79b-5979-4021-9bfc-038fe8d34b02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2586a79b-5979-4021-9bfc-038fe8d34b02', 'volume_size': 1}
Sep 07 18:08:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:08:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:08:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1705704355',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2586a79b-5979-4021-9bfc-038fe8d34b02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59968babfef34f5a8e1fe447402afc0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:08:10Z,use_quota=True,user_id='22637218d0f042b28640a1f2a812731c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:08:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Creating volume 2586a79b-5979-4021-9bfc-038fe8d34b02 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:08:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:08:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:08:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:08:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:08:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:08:10 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:08:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2586a79b-5979-4021-9bfc-038fe8d34b02 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:10 devstack sudo[97460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2586a79b-5979-4021-9bfc-038fe8d34b02 1073741824
Sep 07 18:08:10 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:11 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2586a79b-5979-4021-9bfc-038fe8d34b02 1073741824" returned: 0 in 0.677s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2586a79b-5979-4021-9bfc-038fe8d34b02 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:11 devstack sudo[97466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2586a79b-5979-4021-9bfc-038fe8d34b02
Sep 07 18:08:11 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:11 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2586a79b-5979-4021-9bfc-038fe8d34b02" returned: 0 in 0.292s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:08:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9f7cd376-4021-4374-a313-ea640c826b75 tempest-VolumesSnapshotListTestJSON-1889061291 None] Acquiring lock "cinder-acaddc12-f575-4c90-9a28-c8bb799fbf40-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:08:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca50757-b183-4067-9e52-ed820fbdf2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2586a79b-5979-4021-9bfc-038fe8d34b02', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e57aba-1fb1-4ddd-8276-e96267281bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9f7cd376-4021-4374-a313-ea640c826b75 tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "cinder-acaddc12-f575-4c90-9a28-c8bb799fbf40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:08:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9f7cd376-4021-4374-a313-ea640c826b75 tempest-VolumesSnapshotListTestJSON-1889061291 None] Acquiring lock "cinder-quobyte-beb06df5-e979-4227-8f17-042b700ba21a" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:08:11 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Volume volume-2586a79b-5979-4021-9bfc-038fe8d34b02 (2586a79b-5979-4021-9bfc-038fe8d34b02): created successfully
Sep 07 18:08:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e57aba-1fb1-4ddd-8276-e96267281bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Flow 'volume_create_manager' (b1288900-fb4c-4aac-ae0d-d0eefc5d9ddf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:08:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9f7cd376-4021-4374-a313-ea640c826b75 tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "cinder-quobyte-beb06df5-e979-4227-8f17-042b700ba21a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:08:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9f7cd376-4021-4374-a313-ea640c826b75 tempest-VolumesSnapshotListTestJSON-1889061291 None] Acquiring lock "cinder-quobyte-acaddc12-f575-4c90-9a28-c8bb799fbf40" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:08:11 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-01b871e0-ef47-41b0-9857-bda9226b142c tempest-VolumesListAdminTestJSON-1448364767 None] Created volume successfully.
Sep 07 18:08:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9f7cd376-4021-4374-a313-ea640c826b75 tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "cinder-quobyte-acaddc12-f575-4c90-9a28-c8bb799fbf40" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:08:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9f7cd376-4021-4374-a313-ea640c826b75 tempest-VolumesSnapshotListTestJSON-1889061291 None] Deleting offline snapshot acaddc12-f575-4c90-9a28-c8bb799fbf40 of volume beb06df5-e979-4227-8f17-042b700ba21a {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:08:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9f7cd376-4021-4374-a313-ea640c826b75 tempest-VolumesSnapshotListTestJSON-1889061291 None] snapshot_file for this snap is: volume-beb06df5-e979-4227-8f17-042b700ba21a.acaddc12-f575-4c90-9a28-c8bb799fbf40 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:08:11 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[197c48d4-cd45-45de-b1d9-84cf8d2c3564]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:08:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9f7cd376-4021-4374-a313-ea640c826b75 tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.acaddc12-f575-4c90-9a28-c8bb799fbf40 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:11 devstack sudo[97469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.acaddc12-f575-4c90-9a28-c8bb799fbf40
Sep 07 18:08:11 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:11 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9f7cd376-4021-4374-a313-ea640c826b75 tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.acaddc12-f575-4c90-9a28-c8bb799fbf40" returned: 0 in 0.364s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9f7cd376-4021-4374-a313-ea640c826b75 tempest-VolumesSnapshotListTestJSON-1889061291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beb06df5-e979-4227-8f17-042b700ba21a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:08:11 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a713c2f-c601-4b3c-bb57-4c044ea14d5a]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:08:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9f7cd376-4021-4374-a313-ea640c826b75 tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:12 devstack sudo[97475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae
Sep 07 18:08:12 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:12 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9f7cd376-4021-4374-a313-ea640c826b75 tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae" returned: 0 in 0.415s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9f7cd376-4021-4374-a313-ea640c826b75 tempest-VolumesSnapshotListTestJSON-1889061291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beb06df5-e979-4227-8f17-042b700ba21a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:08:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9f7cd376-4021-4374-a313-ea640c826b75 tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.acaddc12-f575-4c90-9a28-c8bb799fbf40 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:12 devstack sudo[97480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.acaddc12-f575-4c90-9a28-c8bb799fbf40
Sep 07 18:08:12 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:12 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9f7cd376-4021-4374-a313-ea640c826b75 tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.acaddc12-f575-4c90-9a28-c8bb799fbf40" returned: 0 in 0.525s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9f7cd376-4021-4374-a313-ea640c826b75 tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.acaddc12-f575-4c90-9a28-c8bb799fbf40 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:12 devstack sudo[97486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.acaddc12-f575-4c90-9a28-c8bb799fbf40
Sep 07 18:08:12 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:12 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:08:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Flow 'volume_create_manager' (5213f3e1-3f4a-474e-b6dd-87f2abd284b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:08:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6001bbe7-439a-4534-9064-ea4e3ead4913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6001bbe7-439a-4534-9064-ea4e3ead4913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-585103939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e4cc001-376d-411f-837b-5976d134730d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59968babfef34f5a8e1fe447402afc0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:08:13Z,use_quota=True,user_id='22637218d0f042b28640a1f2a812731c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b8cf5b0-3012-4b78-86d6-950f5f3c0d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b8cf5b0-3012-4b78-86d6-950f5f3c0d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ffd3ba9-697a-4a98-bb26-7517cfbc286b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ffd3ba9-697a-4a98-bb26-7517cfbc286b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e4cc001-376d-411f-837b-5976d134730d', 'volume_name': 'volume-9e4cc001-376d-411f-837b-5976d134730d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35e3cd7a-4432-42e6-931a-76a4b2cb8b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35e3cd7a-4432-42e6-931a-76a4b2cb8b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e29dcd-8c1e-4922-8c9b-ca5f5e979d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:13 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Volume 9e4cc001-376d-411f-837b-5976d134730d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e4cc001-376d-411f-837b-5976d134730d', 'volume_size': 1}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-585103939',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e4cc001-376d-411f-837b-5976d134730d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59968babfef34f5a8e1fe447402afc0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:08:13Z,use_quota=True,user_id='22637218d0f042b28640a1f2a812731c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Creating volume 9e4cc001-376d-411f-837b-5976d134730d {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:08:13 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9e4cc001-376d-411f-837b-5976d134730d 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:13 devstack sudo[97488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9e4cc001-376d-411f-837b-5976d134730d 1073741824
Sep 07 18:08:13 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:13 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9f7cd376-4021-4374-a313-ea640c826b75 tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.acaddc12-f575-4c90-9a28-c8bb799fbf40" returned: 0 in 0.264s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9f7cd376-4021-4374-a313-ea640c826b75 tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "cinder-quobyte-acaddc12-f575-4c90-9a28-c8bb799fbf40" released by "_delete_snapshot" :: held 1.674s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9f7cd376-4021-4374-a313-ea640c826b75 tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "cinder-quobyte-beb06df5-e979-4227-8f17-042b700ba21a" released by "delete_snapshot" :: held 1.696s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-9f7cd376-4021-4374-a313-ea640c826b75 tempest-VolumesSnapshotListTestJSON-1889061291 None] Created reservations ['d0266806-48dc-4559-a97b-63293af21bff', '8f7ab204-6aa2-46b5-b1b5-985466ea4361', 'c1692833-a72d-4612-9be7-618e84f9002c', '4610d702-21fb-49ce-a7eb-19a62b7a6e99'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:08:13 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9f7cd376-4021-4374-a313-ea640c826b75 tempest-VolumesSnapshotListTestJSON-1889061291 None] Delete snapshot completed successfully.
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9f7cd376-4021-4374-a313-ea640c826b75 tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "cinder-acaddc12-f575-4c90-9a28-c8bb799fbf40-delete_snapshot" released by "delete_snapshot" :: held 1.862s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:08:13 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9e4cc001-376d-411f-837b-5976d134730d 1073741824" returned: 0 in 0.468s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9e4cc001-376d-411f-837b-5976d134730d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:13 devstack sudo[97495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9e4cc001-376d-411f-837b-5976d134730d
Sep 07 18:08:13 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-936b0952-0ee1-4cba-b8ef-b81c76b2810c tempest-VolumesSnapshotListTestJSON-1889061291 None] Acquiring lock "cinder-a70b772a-b2b7-4db8-90ed-219b89ba52ae-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-936b0952-0ee1-4cba-b8ef-b81c76b2810c tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "cinder-a70b772a-b2b7-4db8-90ed-219b89ba52ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-936b0952-0ee1-4cba-b8ef-b81c76b2810c tempest-VolumesSnapshotListTestJSON-1889061291 None] Acquiring lock "cinder-quobyte-beb06df5-e979-4227-8f17-042b700ba21a" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-936b0952-0ee1-4cba-b8ef-b81c76b2810c tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "cinder-quobyte-beb06df5-e979-4227-8f17-042b700ba21a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-936b0952-0ee1-4cba-b8ef-b81c76b2810c tempest-VolumesSnapshotListTestJSON-1889061291 None] Acquiring lock "cinder-quobyte-a70b772a-b2b7-4db8-90ed-219b89ba52ae" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-936b0952-0ee1-4cba-b8ef-b81c76b2810c tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "cinder-quobyte-a70b772a-b2b7-4db8-90ed-219b89ba52ae" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-936b0952-0ee1-4cba-b8ef-b81c76b2810c tempest-VolumesSnapshotListTestJSON-1889061291 None] Deleting offline snapshot a70b772a-b2b7-4db8-90ed-219b89ba52ae of volume beb06df5-e979-4227-8f17-042b700ba21a {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-936b0952-0ee1-4cba-b8ef-b81c76b2810c tempest-VolumesSnapshotListTestJSON-1889061291 None] snapshot_file for this snap is: volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf04a818-6e87-4196-a0c2-5a1a7511f635]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-936b0952-0ee1-4cba-b8ef-b81c76b2810c tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:13 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9e4cc001-376d-411f-837b-5976d134730d" returned: 0 in 0.293s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e29dcd-8c1e-4922-8c9b-ca5f5e979d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e4cc001-376d-411f-837b-5976d134730d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0316e1db-6d05-4b2e-bdc5-6724aa0945b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:13 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Volume volume-9e4cc001-376d-411f-837b-5976d134730d (9e4cc001-376d-411f-837b-5976d134730d): created successfully
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0316e1db-6d05-4b2e-bdc5-6724aa0945b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:13 devstack sudo[97497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae
Sep 07 18:08:13 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Flow 'volume_create_manager' (5213f3e1-3f4a-474e-b6dd-87f2abd284b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:08:13 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d92d10f8-1547-486e-b437-d7aa4faad9de tempest-VolumesListAdminTestJSON-1448364767 None] Created volume successfully.
Sep 07 18:08:14 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-936b0952-0ee1-4cba-b8ef-b81c76b2810c tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae" returned: 0 in 0.396s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-936b0952-0ee1-4cba-b8ef-b81c76b2810c tempest-VolumesSnapshotListTestJSON-1889061291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beb06df5-e979-4227-8f17-042b700ba21a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:08:14 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3f3d78-4116-4bdb-943f-3bb04607f34a]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:08:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-936b0952-0ee1-4cba-b8ef-b81c76b2810c tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:14 devstack sudo[97503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea
Sep 07 18:08:14 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:14 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-936b0952-0ee1-4cba-b8ef-b81c76b2810c tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea" returned: 0 in 0.370s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-936b0952-0ee1-4cba-b8ef-b81c76b2810c tempest-VolumesSnapshotListTestJSON-1889061291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beb06df5-e979-4227-8f17-042b700ba21a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:08:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-936b0952-0ee1-4cba-b8ef-b81c76b2810c tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:14 devstack sudo[97508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae
Sep 07 18:08:14 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:15 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-936b0952-0ee1-4cba-b8ef-b81c76b2810c tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae" returned: 0 in 0.439s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-936b0952-0ee1-4cba-b8ef-b81c76b2810c tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:15 devstack sudo[97517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae
Sep 07 18:08:15 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:15 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-936b0952-0ee1-4cba-b8ef-b81c76b2810c tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.a70b772a-b2b7-4db8-90ed-219b89ba52ae" returned: 0 in 0.291s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-936b0952-0ee1-4cba-b8ef-b81c76b2810c tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "cinder-quobyte-a70b772a-b2b7-4db8-90ed-219b89ba52ae" released by "_delete_snapshot" :: held 1.618s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-936b0952-0ee1-4cba-b8ef-b81c76b2810c tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "cinder-quobyte-beb06df5-e979-4227-8f17-042b700ba21a" released by "delete_snapshot" :: held 1.657s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-936b0952-0ee1-4cba-b8ef-b81c76b2810c tempest-VolumesSnapshotListTestJSON-1889061291 None] Created reservations ['6487448c-e775-411f-9e3d-7409b57b4578', '8283b89e-68e5-462c-a947-fd1a425eb759', '87d5ee00-9225-429e-914a-2534312eb638', 'f22d2208-0d1b-4b92-9dfc-c0178b7efa4a'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:08:15 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-936b0952-0ee1-4cba-b8ef-b81c76b2810c tempest-VolumesSnapshotListTestJSON-1889061291 None] Delete snapshot completed successfully.
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-936b0952-0ee1-4cba-b8ef-b81c76b2810c tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "cinder-a70b772a-b2b7-4db8-90ed-219b89ba52ae-delete_snapshot" released by "delete_snapshot" :: held 1.865s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f7f70ad1-c6a9-4c1a-95a2-b823fbc0d5ce tempest-VolumesSnapshotListTestJSON-1889061291 None] Acquiring lock "cinder-f7ce9bf6-0144-4a3d-be23-7adab1776cea-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f7f70ad1-c6a9-4c1a-95a2-b823fbc0d5ce tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "cinder-f7ce9bf6-0144-4a3d-be23-7adab1776cea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f7f70ad1-c6a9-4c1a-95a2-b823fbc0d5ce tempest-VolumesSnapshotListTestJSON-1889061291 None] Acquiring lock "cinder-quobyte-beb06df5-e979-4227-8f17-042b700ba21a" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Flow 'volume_create_manager' (627463a2-595c-4458-8da0-79452690dfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7d0605-f762-4844-93ac-e2e0dcd6191c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f7f70ad1-c6a9-4c1a-95a2-b823fbc0d5ce tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "cinder-quobyte-beb06df5-e979-4227-8f17-042b700ba21a" acquired by "delete_snapshot" :: waited 0.062s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f7f70ad1-c6a9-4c1a-95a2-b823fbc0d5ce tempest-VolumesSnapshotListTestJSON-1889061291 None] Acquiring lock "cinder-quobyte-f7ce9bf6-0144-4a3d-be23-7adab1776cea" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e7d0605-f762-4844-93ac-e2e0dcd6191c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b56ccc5a-76c8-48db-bdfe-afaa97419c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e501ef9b35d4dcca612c29e7b4ccf7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:08:16Z,use_quota=True,user_id='61370a3612394b0197c924d86b8ff043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd1729af-3151-4912-81c0-0dda9da32d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd1729af-3151-4912-81c0-0dda9da32d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c8b875-09a5-4bb1-8e9d-8756abbaad6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c8b875-09a5-4bb1-8e9d-8756abbaad6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b56ccc5a-76c8-48db-bdfe-afaa97419c40', 'volume_name': 'volume-b56ccc5a-76c8-48db-bdfe-afaa97419c40', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a78325-ff0e-4f2b-807b-f4b773885f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19a78325-ff0e-4f2b-807b-f4b773885f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc3932b8-5cc7-49fb-ac34-256cc40d9134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:15 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Volume b56ccc5a-76c8-48db-bdfe-afaa97419c40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b56ccc5a-76c8-48db-bdfe-afaa97419c40', 'volume_size': 1}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b56ccc5a-76c8-48db-bdfe-afaa97419c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e501ef9b35d4dcca612c29e7b4ccf7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:08:16Z,use_quota=True,user_id='61370a3612394b0197c924d86b8ff043',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Creating volume b56ccc5a-76c8-48db-bdfe-afaa97419c40 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:08:15 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:08:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b56ccc5a-76c8-48db-bdfe-afaa97419c40 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f7f70ad1-c6a9-4c1a-95a2-b823fbc0d5ce tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "cinder-quobyte-f7ce9bf6-0144-4a3d-be23-7adab1776cea" acquired by "_delete_snapshot" :: waited 0.093s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:08:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-f7f70ad1-c6a9-4c1a-95a2-b823fbc0d5ce tempest-VolumesSnapshotListTestJSON-1889061291 None] Deleting offline snapshot f7ce9bf6-0144-4a3d-be23-7adab1776cea of volume beb06df5-e979-4227-8f17-042b700ba21a {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:08:16 devstack sudo[97521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b56ccc5a-76c8-48db-bdfe-afaa97419c40 1073741824
Sep 07 18:08:16 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-f7f70ad1-c6a9-4c1a-95a2-b823fbc0d5ce tempest-VolumesSnapshotListTestJSON-1889061291 None] snapshot_file for this snap is: volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:08:16 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c840dbaa-1ec4-4863-83ed-140d8e3c03e4]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:08:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f7f70ad1-c6a9-4c1a-95a2-b823fbc0d5ce tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:16 devstack sudo[97523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea
Sep 07 18:08:16 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:16 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f7f70ad1-c6a9-4c1a-95a2-b823fbc0d5ce tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea" returned: 0 in 0.433s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-f7f70ad1-c6a9-4c1a-95a2-b823fbc0d5ce tempest-VolumesSnapshotListTestJSON-1889061291 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-beb06df5-e979-4227-8f17-042b700ba21a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:08:16 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:16 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[96205943-c62d-482d-b8d2-c9d1eb1d9d95]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:08:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f7f70ad1-c6a9-4c1a-95a2-b823fbc0d5ce tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b56ccc5a-76c8-48db-bdfe-afaa97419c40 1073741824" returned: 0 in 0.577s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b56ccc5a-76c8-48db-bdfe-afaa97419c40 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:16 devstack sudo[97536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b56ccc5a-76c8-48db-bdfe-afaa97419c40
Sep 07 18:08:16 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:16 devstack sudo[97535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a
Sep 07 18:08:16 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:16 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b56ccc5a-76c8-48db-bdfe-afaa97419c40" returned: 0 in 0.274s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:08:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc3932b8-5cc7-49fb-ac34-256cc40d9134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b56ccc5a-76c8-48db-bdfe-afaa97419c40', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8d25abd-d43d-4a61-9e46-8ba294d89679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:16 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Volume volume-b56ccc5a-76c8-48db-bdfe-afaa97419c40 (b56ccc5a-76c8-48db-bdfe-afaa97419c40): created successfully
Sep 07 18:08:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8d25abd-d43d-4a61-9e46-8ba294d89679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Flow 'volume_create_manager' (627463a2-595c-4458-8da0-79452690dfca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:08:16 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-123f3d82-3c32-4453-a19a-4ef0b54475be tempest-VolumesListAdminTestJSON-1117070376 None] Created volume successfully.
Sep 07 18:08:16 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f7f70ad1-c6a9-4c1a-95a2-b823fbc0d5ce tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a" returned: 0 in 0.435s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f7f70ad1-c6a9-4c1a-95a2-b823fbc0d5ce tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:17 devstack sudo[97554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea
Sep 07 18:08:17 devstack sudo[97554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:17 devstack sudo[97554]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f7f70ad1-c6a9-4c1a-95a2-b823fbc0d5ce tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea" returned: 0 in 0.376s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f7f70ad1-c6a9-4c1a-95a2-b823fbc0d5ce tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:17 devstack sudo[97563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea
Sep 07 18:08:17 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:17 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f7f70ad1-c6a9-4c1a-95a2-b823fbc0d5ce tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a.f7ce9bf6-0144-4a3d-be23-7adab1776cea" returned: 0 in 0.259s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f7f70ad1-c6a9-4c1a-95a2-b823fbc0d5ce tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "cinder-quobyte-f7ce9bf6-0144-4a3d-be23-7adab1776cea" released by "_delete_snapshot" :: held 1.650s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:08:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f7f70ad1-c6a9-4c1a-95a2-b823fbc0d5ce tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "cinder-quobyte-beb06df5-e979-4227-8f17-042b700ba21a" released by "delete_snapshot" :: held 1.754s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:08:17 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-f7f70ad1-c6a9-4c1a-95a2-b823fbc0d5ce tempest-VolumesSnapshotListTestJSON-1889061291 None] Created reservations ['7812a145-74e5-47ba-9851-bbdcbd400324', '36bef258-f05d-443d-abde-389e5e9b8736', 'c5e0d9ea-5015-4741-bff3-179e642e69a5', 'bd48d62f-a12e-490c-ace7-7c8cac72f828'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:08:17 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f7f70ad1-c6a9-4c1a-95a2-b823fbc0d5ce tempest-VolumesSnapshotListTestJSON-1889061291 None] Delete snapshot completed successfully.
Sep 07 18:08:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f7f70ad1-c6a9-4c1a-95a2-b823fbc0d5ce tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "cinder-f7ce9bf6-0144-4a3d-be23-7adab1776cea-delete_snapshot" released by "delete_snapshot" :: held 1.956s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:08:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f31b4043-a9e3-4589-87b2-ba50298c619c tempest-VolumesSnapshotListTestJSON-1889061291 None] Acquiring lock "cinder-beb06df5-e979-4227-8f17-042b700ba21a-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:08:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cbe04905-2f1d-4b9c-affd-6227a03e017d tempest-VolumesListAdminTestJSON-1117070376 None] Acquiring lock "cinder-b56ccc5a-76c8-48db-bdfe-afaa97419c40-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:08:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f31b4043-a9e3-4589-87b2-ba50298c619c tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "cinder-beb06df5-e979-4227-8f17-042b700ba21a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:08:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cbe04905-2f1d-4b9c-affd-6227a03e017d tempest-VolumesListAdminTestJSON-1117070376 None] Lock "cinder-b56ccc5a-76c8-48db-bdfe-afaa97419c40-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:08:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f31b4043-a9e3-4589-87b2-ba50298c619c tempest-VolumesSnapshotListTestJSON-1889061291 None] Acquiring lock "cinder-quobyte-beb06df5-e979-4227-8f17-042b700ba21a" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:08:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cbe04905-2f1d-4b9c-affd-6227a03e017d tempest-VolumesListAdminTestJSON-1117070376 None] Acquiring lock "cinder-quobyte-b56ccc5a-76c8-48db-bdfe-afaa97419c40" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:08:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f31b4043-a9e3-4589-87b2-ba50298c619c tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "cinder-quobyte-beb06df5-e979-4227-8f17-042b700ba21a" acquired by "delete_volume" :: waited 0.033s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:08:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cbe04905-2f1d-4b9c-affd-6227a03e017d tempest-VolumesListAdminTestJSON-1117070376 None] Lock "cinder-quobyte-b56ccc5a-76c8-48db-bdfe-afaa97419c40" acquired by "delete_volume" :: waited 0.065s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:08:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-86722069-ee90-4927-8b11-645f0853abc1 tempest-VolumesListAdminTestJSON-1448364767 None] Acquiring lock "cinder-9e4cc001-376d-411f-837b-5976d134730d-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:08:18 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6556c489-7f2b-4b83-9398-ac66ee2a92f5]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:08:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f31b4043-a9e3-4589-87b2-ba50298c619c tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:18 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b6fa2e-afcc-4264-98c8-942be2713b67]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:08:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cbe04905-2f1d-4b9c-affd-6227a03e017d tempest-VolumesListAdminTestJSON-1117070376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b56ccc5a-76c8-48db-bdfe-afaa97419c40 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-86722069-ee90-4927-8b11-645f0853abc1 tempest-VolumesListAdminTestJSON-1448364767 None] Lock "cinder-9e4cc001-376d-411f-837b-5976d134730d-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:08:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-86722069-ee90-4927-8b11-645f0853abc1 tempest-VolumesListAdminTestJSON-1448364767 None] Acquiring lock "cinder-quobyte-9e4cc001-376d-411f-837b-5976d134730d" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:08:18 devstack sudo[97567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a
Sep 07 18:08:18 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-86722069-ee90-4927-8b11-645f0853abc1 tempest-VolumesListAdminTestJSON-1448364767 None] Lock "cinder-quobyte-9e4cc001-376d-411f-837b-5976d134730d" acquired by "delete_volume" :: waited 0.038s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:08:18 devstack sudo[97568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b56ccc5a-76c8-48db-bdfe-afaa97419c40
Sep 07 18:08:18 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:18 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[650f2407-0a28-4dbf-8aba-588aef162f1b]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:08:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-86722069-ee90-4927-8b11-645f0853abc1 tempest-VolumesListAdminTestJSON-1448364767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9e4cc001-376d-411f-837b-5976d134730d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:18 devstack sudo[97571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9e4cc001-376d-411f-837b-5976d134730d
Sep 07 18:08:18 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:18 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f31b4043-a9e3-4589-87b2-ba50298c619c tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a" returned: 0 in 0.504s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f31b4043-a9e3-4589-87b2-ba50298c619c tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:18 devstack sudo[97580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a
Sep 07 18:08:18 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:18 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cbe04905-2f1d-4b9c-affd-6227a03e017d tempest-VolumesListAdminTestJSON-1117070376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b56ccc5a-76c8-48db-bdfe-afaa97419c40" returned: 0 in 0.520s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cbe04905-2f1d-4b9c-affd-6227a03e017d tempest-VolumesListAdminTestJSON-1117070376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b56ccc5a-76c8-48db-bdfe-afaa97419c40 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:18 devstack sudo[97582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b56ccc5a-76c8-48db-bdfe-afaa97419c40
Sep 07 18:08:18 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:19 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-86722069-ee90-4927-8b11-645f0853abc1 tempest-VolumesListAdminTestJSON-1448364767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9e4cc001-376d-411f-837b-5976d134730d" returned: 0 in 0.522s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-86722069-ee90-4927-8b11-645f0853abc1 tempest-VolumesListAdminTestJSON-1448364767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9e4cc001-376d-411f-837b-5976d134730d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:19 devstack sudo[97588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9e4cc001-376d-411f-837b-5976d134730d
Sep 07 18:08:19 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:19 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:19 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f31b4043-a9e3-4589-87b2-ba50298c619c tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-beb06df5-e979-4227-8f17-042b700ba21a" returned: 0 in 0.366s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cbe04905-2f1d-4b9c-affd-6227a03e017d tempest-VolumesListAdminTestJSON-1117070376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b56ccc5a-76c8-48db-bdfe-afaa97419c40" returned: 0 in 0.344s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f31b4043-a9e3-4589-87b2-ba50298c619c tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "cinder-quobyte-beb06df5-e979-4227-8f17-042b700ba21a" released by "delete_volume" :: held 1.044s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cbe04905-2f1d-4b9c-affd-6227a03e017d tempest-VolumesListAdminTestJSON-1117070376 None] Lock "cinder-quobyte-b56ccc5a-76c8-48db-bdfe-afaa97419c40" released by "delete_volume" :: held 1.021s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-f31b4043-a9e3-4589-87b2-ba50298c619c tempest-VolumesSnapshotListTestJSON-1889061291 None] Created reservations ['9229a9cc-a5ed-43eb-b4db-5007e164a6ae', 'c31e752d-3074-4e56-8ea7-6a76af8fe71f', 'f8f3e598-ba7a-428d-aeb4-db717a915c46', '67532bc5-fd60-43ae-b682-632e6651059b'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-cbe04905-2f1d-4b9c-affd-6227a03e017d tempest-VolumesListAdminTestJSON-1117070376 None] Created reservations ['a1c885fd-1127-4f41-845c-4df25f7e3cb9', 'c58f8719-8141-4692-8182-0ffec50e04df', '6526769b-a449-454b-8fea-e8645fd656a1', '1ae6ee1b-699b-4226-95d1-60bbc5158762'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:08:19 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-86722069-ee90-4927-8b11-645f0853abc1 tempest-VolumesListAdminTestJSON-1448364767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9e4cc001-376d-411f-837b-5976d134730d" returned: 0 in 0.489s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-86722069-ee90-4927-8b11-645f0853abc1 tempest-VolumesListAdminTestJSON-1448364767 None] Lock "cinder-quobyte-9e4cc001-376d-411f-837b-5976d134730d" released by "delete_volume" :: held 1.094s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cbe04905-2f1d-4b9c-affd-6227a03e017d tempest-VolumesListAdminTestJSON-1117070376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cbe04905-2f1d-4b9c-affd-6227a03e017d tempest-VolumesListAdminTestJSON-1117070376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cbe04905-2f1d-4b9c-affd-6227a03e017d tempest-VolumesListAdminTestJSON-1117070376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cbe04905-2f1d-4b9c-affd-6227a03e017d tempest-VolumesListAdminTestJSON-1117070376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cbe04905-2f1d-4b9c-affd-6227a03e017d tempest-VolumesListAdminTestJSON-1117070376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cbe04905-2f1d-4b9c-affd-6227a03e017d tempest-VolumesListAdminTestJSON-1117070376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:19 devstack sudo[97619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:08:19 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f31b4043-a9e3-4589-87b2-ba50298c619c tempest-VolumesSnapshotListTestJSON-1889061291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f31b4043-a9e3-4589-87b2-ba50298c619c tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f31b4043-a9e3-4589-87b2-ba50298c619c tempest-VolumesSnapshotListTestJSON-1889061291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f31b4043-a9e3-4589-87b2-ba50298c619c tempest-VolumesSnapshotListTestJSON-1889061291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f31b4043-a9e3-4589-87b2-ba50298c619c tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f31b4043-a9e3-4589-87b2-ba50298c619c tempest-VolumesSnapshotListTestJSON-1889061291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:19 devstack sudo[97628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:08:19 devstack sudo[97628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-86722069-ee90-4927-8b11-645f0853abc1 tempest-VolumesListAdminTestJSON-1448364767 None] Created reservations ['3638c1e8-39bd-47a1-af71-53164cd4f683', '7872c7c2-a362-446c-9eda-27be68143a81', '0016d4f7-557d-4f86-97d1-ccdc4d14287d', 'e44c71be-57b3-4275-9e71-3e741df0d70d'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-86722069-ee90-4927-8b11-645f0853abc1 tempest-VolumesListAdminTestJSON-1448364767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-86722069-ee90-4927-8b11-645f0853abc1 tempest-VolumesListAdminTestJSON-1448364767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-86722069-ee90-4927-8b11-645f0853abc1 tempest-VolumesListAdminTestJSON-1448364767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-86722069-ee90-4927-8b11-645f0853abc1 tempest-VolumesListAdminTestJSON-1448364767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-86722069-ee90-4927-8b11-645f0853abc1 tempest-VolumesListAdminTestJSON-1448364767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-86722069-ee90-4927-8b11-645f0853abc1 tempest-VolumesListAdminTestJSON-1448364767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:20 devstack sudo[97637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:08:20 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:20 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cbe04905-2f1d-4b9c-affd-6227a03e017d tempest-VolumesListAdminTestJSON-1117070376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.549s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:20 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-cbe04905-2f1d-4b9c-affd-6227a03e017d tempest-VolumesListAdminTestJSON-1117070376 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:08:20 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-cbe04905-2f1d-4b9c-affd-6227a03e017d tempest-VolumesListAdminTestJSON-1117070376 None] Deleted volume successfully.
Sep 07 18:08:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cbe04905-2f1d-4b9c-affd-6227a03e017d tempest-VolumesListAdminTestJSON-1117070376 None] Lock "cinder-b56ccc5a-76c8-48db-bdfe-afaa97419c40-delete_volume" released by "delete_volume" :: held 2.092s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:08:20 devstack sudo[97628]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f31b4043-a9e3-4589-87b2-ba50298c619c tempest-VolumesSnapshotListTestJSON-1889061291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.578s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:20 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f31b4043-a9e3-4589-87b2-ba50298c619c tempest-VolumesSnapshotListTestJSON-1889061291 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:08:20 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f31b4043-a9e3-4589-87b2-ba50298c619c tempest-VolumesSnapshotListTestJSON-1889061291 None] Deleted volume successfully.
Sep 07 18:08:20 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-86722069-ee90-4927-8b11-645f0853abc1 tempest-VolumesListAdminTestJSON-1448364767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.406s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:20 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-86722069-ee90-4927-8b11-645f0853abc1 tempest-VolumesListAdminTestJSON-1448364767 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:08:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f31b4043-a9e3-4589-87b2-ba50298c619c tempest-VolumesSnapshotListTestJSON-1889061291 None] Lock "cinder-beb06df5-e979-4227-8f17-042b700ba21a-delete_volume" released by "delete_volume" :: held 2.296s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:08:20 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-86722069-ee90-4927-8b11-645f0853abc1 tempest-VolumesListAdminTestJSON-1448364767 None] Deleted volume successfully.
Sep 07 18:08:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-86722069-ee90-4927-8b11-645f0853abc1 tempest-VolumesListAdminTestJSON-1448364767 None] Lock "cinder-9e4cc001-376d-411f-837b-5976d134730d-delete_volume" released by "delete_volume" :: held 2.066s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:08:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-372f0fbc-1afb-4ad6-b8b1-b8d90b87a9e0 tempest-VolumesListAdminTestJSON-1448364767 None] Acquiring lock "cinder-2586a79b-5979-4021-9bfc-038fe8d34b02-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:08:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-372f0fbc-1afb-4ad6-b8b1-b8d90b87a9e0 tempest-VolumesListAdminTestJSON-1448364767 None] Lock "cinder-2586a79b-5979-4021-9bfc-038fe8d34b02-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:08:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-372f0fbc-1afb-4ad6-b8b1-b8d90b87a9e0 tempest-VolumesListAdminTestJSON-1448364767 None] Acquiring lock "cinder-quobyte-2586a79b-5979-4021-9bfc-038fe8d34b02" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:08:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-372f0fbc-1afb-4ad6-b8b1-b8d90b87a9e0 tempest-VolumesListAdminTestJSON-1448364767 None] Lock "cinder-quobyte-2586a79b-5979-4021-9bfc-038fe8d34b02" acquired by "delete_volume" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:08:20 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c551ad7-74b5-4d18-9bad-aff36d2d2d49]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:08:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-372f0fbc-1afb-4ad6-b8b1-b8d90b87a9e0 tempest-VolumesListAdminTestJSON-1448364767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2586a79b-5979-4021-9bfc-038fe8d34b02 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:20 devstack sudo[97643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2586a79b-5979-4021-9bfc-038fe8d34b02
Sep 07 18:08:20 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:21 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-372f0fbc-1afb-4ad6-b8b1-b8d90b87a9e0 tempest-VolumesListAdminTestJSON-1448364767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2586a79b-5979-4021-9bfc-038fe8d34b02" returned: 0 in 0.488s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-372f0fbc-1afb-4ad6-b8b1-b8d90b87a9e0 tempest-VolumesListAdminTestJSON-1448364767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2586a79b-5979-4021-9bfc-038fe8d34b02 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:21 devstack sudo[97650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2586a79b-5979-4021-9bfc-038fe8d34b02
Sep 07 18:08:21 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:21 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-372f0fbc-1afb-4ad6-b8b1-b8d90b87a9e0 tempest-VolumesListAdminTestJSON-1448364767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2586a79b-5979-4021-9bfc-038fe8d34b02" returned: 0 in 0.292s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-372f0fbc-1afb-4ad6-b8b1-b8d90b87a9e0 tempest-VolumesListAdminTestJSON-1448364767 None] Lock "cinder-quobyte-2586a79b-5979-4021-9bfc-038fe8d34b02" released by "delete_volume" :: held 0.838s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:08:21 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-372f0fbc-1afb-4ad6-b8b1-b8d90b87a9e0 tempest-VolumesListAdminTestJSON-1448364767 None] Created reservations ['c57a9511-39f2-4fe7-b98c-c6201d987ce9', 'a2efe395-5aab-40ee-9249-1bb492d46c5d', 'f45a8fd0-7b9f-4bc6-a66d-1e80bac1b6fb', '2d992465-6d70-4b0e-b55b-abe3b0de301b'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:08:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-372f0fbc-1afb-4ad6-b8b1-b8d90b87a9e0 tempest-VolumesListAdminTestJSON-1448364767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:08:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-372f0fbc-1afb-4ad6-b8b1-b8d90b87a9e0 tempest-VolumesListAdminTestJSON-1448364767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:08:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-372f0fbc-1afb-4ad6-b8b1-b8d90b87a9e0 tempest-VolumesListAdminTestJSON-1448364767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:08:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-372f0fbc-1afb-4ad6-b8b1-b8d90b87a9e0 tempest-VolumesListAdminTestJSON-1448364767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:08:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-372f0fbc-1afb-4ad6-b8b1-b8d90b87a9e0 tempest-VolumesListAdminTestJSON-1448364767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-372f0fbc-1afb-4ad6-b8b1-b8d90b87a9e0 tempest-VolumesListAdminTestJSON-1448364767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:21 devstack sudo[97653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:08:21 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5309640f-5184-409c-b706-a8cb9e560387 tempest-VolumesListAdminTestJSON-1448364767 None] Acquiring lock "cinder-53eea1a9-9a6f-456f-8424-5d5aab5077ee-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:08:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5309640f-5184-409c-b706-a8cb9e560387 tempest-VolumesListAdminTestJSON-1448364767 None] Lock "cinder-53eea1a9-9a6f-456f-8424-5d5aab5077ee-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:08:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5309640f-5184-409c-b706-a8cb9e560387 tempest-VolumesListAdminTestJSON-1448364767 None] Acquiring lock "cinder-quobyte-53eea1a9-9a6f-456f-8424-5d5aab5077ee" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:08:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5309640f-5184-409c-b706-a8cb9e560387 tempest-VolumesListAdminTestJSON-1448364767 None] Lock "cinder-quobyte-53eea1a9-9a6f-456f-8424-5d5aab5077ee" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:08:22 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-372f0fbc-1afb-4ad6-b8b1-b8d90b87a9e0 tempest-VolumesListAdminTestJSON-1448364767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.406s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:22 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-372f0fbc-1afb-4ad6-b8b1-b8d90b87a9e0 tempest-VolumesListAdminTestJSON-1448364767 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:08:22 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-372f0fbc-1afb-4ad6-b8b1-b8d90b87a9e0 tempest-VolumesListAdminTestJSON-1448364767 None] Deleted volume successfully.
Sep 07 18:08:22 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[395d4af0-542d-4370-bd32-b0bfec8e6c9d]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:08:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5309640f-5184-409c-b706-a8cb9e560387 tempest-VolumesListAdminTestJSON-1448364767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-53eea1a9-9a6f-456f-8424-5d5aab5077ee {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-372f0fbc-1afb-4ad6-b8b1-b8d90b87a9e0 tempest-VolumesListAdminTestJSON-1448364767 None] Lock "cinder-2586a79b-5979-4021-9bfc-038fe8d34b02-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:08:22 devstack sudo[97656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-53eea1a9-9a6f-456f-8424-5d5aab5077ee
Sep 07 18:08:22 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:22 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5309640f-5184-409c-b706-a8cb9e560387 tempest-VolumesListAdminTestJSON-1448364767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-53eea1a9-9a6f-456f-8424-5d5aab5077ee" returned: 0 in 0.532s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5309640f-5184-409c-b706-a8cb9e560387 tempest-VolumesListAdminTestJSON-1448364767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-53eea1a9-9a6f-456f-8424-5d5aab5077ee {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:22 devstack sudo[97661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-53eea1a9-9a6f-456f-8424-5d5aab5077ee
Sep 07 18:08:22 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:23 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5309640f-5184-409c-b706-a8cb9e560387 tempest-VolumesListAdminTestJSON-1448364767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-53eea1a9-9a6f-456f-8424-5d5aab5077ee" returned: 0 in 0.397s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5309640f-5184-409c-b706-a8cb9e560387 tempest-VolumesListAdminTestJSON-1448364767 None] Lock "cinder-quobyte-53eea1a9-9a6f-456f-8424-5d5aab5077ee" released by "delete_volume" :: held 1.019s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:08:23 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-5309640f-5184-409c-b706-a8cb9e560387 tempest-VolumesListAdminTestJSON-1448364767 None] Created reservations ['09258fe1-57d3-4026-ab3c-ec2c362694d3', 'a53d219d-bfc1-44f7-8088-104450daead8', '61d0e70d-29cd-4dbc-b65d-4eefdebb3e9d', '4bd4bdf3-b58c-4dd8-89e0-082edf79cb87'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:08:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5309640f-5184-409c-b706-a8cb9e560387 tempest-VolumesListAdminTestJSON-1448364767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:08:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5309640f-5184-409c-b706-a8cb9e560387 tempest-VolumesListAdminTestJSON-1448364767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:08:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5309640f-5184-409c-b706-a8cb9e560387 tempest-VolumesListAdminTestJSON-1448364767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:08:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5309640f-5184-409c-b706-a8cb9e560387 tempest-VolumesListAdminTestJSON-1448364767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:08:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5309640f-5184-409c-b706-a8cb9e560387 tempest-VolumesListAdminTestJSON-1448364767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5309640f-5184-409c-b706-a8cb9e560387 tempest-VolumesListAdminTestJSON-1448364767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:23 devstack sudo[97672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:08:23 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:23 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5309640f-5184-409c-b706-a8cb9e560387 tempest-VolumesListAdminTestJSON-1448364767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.518s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:23 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-5309640f-5184-409c-b706-a8cb9e560387 tempest-VolumesListAdminTestJSON-1448364767 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:08:23 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5309640f-5184-409c-b706-a8cb9e560387 tempest-VolumesListAdminTestJSON-1448364767 None] Deleted volume successfully.
Sep 07 18:08:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5309640f-5184-409c-b706-a8cb9e560387 tempest-VolumesListAdminTestJSON-1448364767 None] Lock "cinder-53eea1a9-9a6f-456f-8424-5d5aab5077ee-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:08:28 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-d9c2992d-628e-4936-a394-f072f6e3a62b req-83dab79b-1a27-4860-8a15-9902b5ae7d9e tempest-TestShelveInstance-2081596184 None] Terminate volume connection completed successfully.
Sep 07 18:08:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-d9c2992d-628e-4936-a394-f072f6e3a62b req-83dab79b-1a27-4860-8a15-9902b5ae7d9e tempest-TestShelveInstance-2081596184 None] Deleting attachment 8163a0a8-d5db-45e6-b927-95f80eee5448. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 07 18:08:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-d9c2992d-628e-4936-a394-f072f6e3a62b req-f1f9dd90-4ef9-4a57-9447-e50339bdf3c1 tempest-TestShelveInstance-2081596184 None] Acquiring lock "cinder-1ce14004-9163-4f09-9f36-cc6816f0a7f4-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:08:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-d9c2992d-628e-4936-a394-f072f6e3a62b req-f1f9dd90-4ef9-4a57-9447-e50339bdf3c1 tempest-TestShelveInstance-2081596184 None] Lock "cinder-1ce14004-9163-4f09-9f36-cc6816f0a7f4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:08:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-d9c2992d-628e-4936-a394-f072f6e3a62b req-f1f9dd90-4ef9-4a57-9447-e50339bdf3c1 tempest-TestShelveInstance-2081596184 None] Acquiring lock "cinder-quobyte-1ce14004-9163-4f09-9f36-cc6816f0a7f4" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:08:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-d9c2992d-628e-4936-a394-f072f6e3a62b req-f1f9dd90-4ef9-4a57-9447-e50339bdf3c1 tempest-TestShelveInstance-2081596184 None] Lock "cinder-quobyte-1ce14004-9163-4f09-9f36-cc6816f0a7f4" acquired by "delete_volume" :: waited 0.035s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:08:28 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9637007d-99db-4ef1-baf5-df9f0558f70d]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:08:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-d9c2992d-628e-4936-a394-f072f6e3a62b req-f1f9dd90-4ef9-4a57-9447-e50339bdf3c1 tempest-TestShelveInstance-2081596184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1ce14004-9163-4f09-9f36-cc6816f0a7f4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:29 devstack sudo[97706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1ce14004-9163-4f09-9f36-cc6816f0a7f4
Sep 07 18:08:29 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:29 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-d9c2992d-628e-4936-a394-f072f6e3a62b req-f1f9dd90-4ef9-4a57-9447-e50339bdf3c1 tempest-TestShelveInstance-2081596184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1ce14004-9163-4f09-9f36-cc6816f0a7f4" returned: 0 in 0.862s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-d9c2992d-628e-4936-a394-f072f6e3a62b req-f1f9dd90-4ef9-4a57-9447-e50339bdf3c1 tempest-TestShelveInstance-2081596184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1ce14004-9163-4f09-9f36-cc6816f0a7f4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:29 devstack sudo[97711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1ce14004-9163-4f09-9f36-cc6816f0a7f4
Sep 07 18:08:29 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:30 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-d9c2992d-628e-4936-a394-f072f6e3a62b req-f1f9dd90-4ef9-4a57-9447-e50339bdf3c1 tempest-TestShelveInstance-2081596184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1ce14004-9163-4f09-9f36-cc6816f0a7f4" returned: 0 in 0.472s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-d9c2992d-628e-4936-a394-f072f6e3a62b req-f1f9dd90-4ef9-4a57-9447-e50339bdf3c1 tempest-TestShelveInstance-2081596184 None] Lock "cinder-quobyte-1ce14004-9163-4f09-9f36-cc6816f0a7f4" released by "delete_volume" :: held 1.426s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:08:30 devstack cinder-volume[87269]: DEBUG cinder.quota [req-d9c2992d-628e-4936-a394-f072f6e3a62b req-f1f9dd90-4ef9-4a57-9447-e50339bdf3c1 tempest-TestShelveInstance-2081596184 None] Created reservations ['3d5cc0c4-50f2-4f39-94ac-2f812bd3a107', 'ecbb1465-dd30-4e15-a2a9-6f80fc0f2b90', '46220f8d-e546-4130-8993-0e82a50262da', '3ad129fa-d517-4c8b-9817-029bb4e25727'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:08:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-d9c2992d-628e-4936-a394-f072f6e3a62b req-f1f9dd90-4ef9-4a57-9447-e50339bdf3c1 tempest-TestShelveInstance-2081596184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:08:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-d9c2992d-628e-4936-a394-f072f6e3a62b req-f1f9dd90-4ef9-4a57-9447-e50339bdf3c1 tempest-TestShelveInstance-2081596184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:08:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-d9c2992d-628e-4936-a394-f072f6e3a62b req-f1f9dd90-4ef9-4a57-9447-e50339bdf3c1 tempest-TestShelveInstance-2081596184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:08:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-d9c2992d-628e-4936-a394-f072f6e3a62b req-f1f9dd90-4ef9-4a57-9447-e50339bdf3c1 tempest-TestShelveInstance-2081596184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:08:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-d9c2992d-628e-4936-a394-f072f6e3a62b req-f1f9dd90-4ef9-4a57-9447-e50339bdf3c1 tempest-TestShelveInstance-2081596184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-d9c2992d-628e-4936-a394-f072f6e3a62b req-f1f9dd90-4ef9-4a57-9447-e50339bdf3c1 tempest-TestShelveInstance-2081596184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:30 devstack sudo[97714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:08:30 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:31 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-d9c2992d-628e-4936-a394-f072f6e3a62b req-f1f9dd90-4ef9-4a57-9447-e50339bdf3c1 tempest-TestShelveInstance-2081596184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.490s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:31 devstack cinder-volume[87269]: DEBUG cinder.manager [req-d9c2992d-628e-4936-a394-f072f6e3a62b req-f1f9dd90-4ef9-4a57-9447-e50339bdf3c1 tempest-TestShelveInstance-2081596184 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:08:31 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-d9c2992d-628e-4936-a394-f072f6e3a62b req-f1f9dd90-4ef9-4a57-9447-e50339bdf3c1 tempest-TestShelveInstance-2081596184 None] Deleted volume successfully.
Sep 07 18:08:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-d9c2992d-628e-4936-a394-f072f6e3a62b req-f1f9dd90-4ef9-4a57-9447-e50339bdf3c1 tempest-TestShelveInstance-2081596184 None] Lock "cinder-1ce14004-9163-4f09-9f36-cc6816f0a7f4-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:08:35 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:08:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Flow 'volume_create_manager' (820937dd-3fd2-4563-bd96-0c79d26bde0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:08:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa5f9dab-ef00-436f-ace2-4d3643b442ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa5f9dab-ef00-436f-ace2-4d3643b442ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-31330295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f5c8f83-4f96-4a8e-b7eb-893e887ad314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ac7fe4099b44fdba434e83006cfa93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:08:35Z,use_quota=True,user_id='20c434e886b342b29cb22eb987f71eb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2576e0fe-4629-4ed2-90b1-41ecbe1ce250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2576e0fe-4629-4ed2-90b1-41ecbe1ce250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761f13f0-7878-4113-9bf6-67d17893e8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761f13f0-7878-4113-9bf6-67d17893e8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f5c8f83-4f96-4a8e-b7eb-893e887ad314', 'volume_name': 'volume-8f5c8f83-4f96-4a8e-b7eb-893e887ad314', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ceaa241-3818-45b2-b5d1-aca840dec004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ceaa241-3818-45b2-b5d1-aca840dec004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e763c2fe-854f-40ea-b103-f87edf76ab44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:35 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Volume 8f5c8f83-4f96-4a8e-b7eb-893e887ad314: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f5c8f83-4f96-4a8e-b7eb-893e887ad314', 'volume_size': 1}
Sep 07 18:08:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:08:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:08:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-31330295',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f5c8f83-4f96-4a8e-b7eb-893e887ad314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ac7fe4099b44fdba434e83006cfa93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:08:35Z,use_quota=True,user_id='20c434e886b342b29cb22eb987f71eb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:08:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Creating volume 8f5c8f83-4f96-4a8e-b7eb-893e887ad314 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:08:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:08:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:08:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:08:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:08:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:08:35 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:08:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8f5c8f83-4f96-4a8e-b7eb-893e887ad314 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:35 devstack sudo[97764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8f5c8f83-4f96-4a8e-b7eb-893e887ad314 1073741824
Sep 07 18:08:35 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:35 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8f5c8f83-4f96-4a8e-b7eb-893e887ad314 1073741824" returned: 0 in 0.560s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8f5c8f83-4f96-4a8e-b7eb-893e887ad314 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:36 devstack sudo[97771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8f5c8f83-4f96-4a8e-b7eb-893e887ad314
Sep 07 18:08:36 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:36 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8f5c8f83-4f96-4a8e-b7eb-893e887ad314" returned: 0 in 0.316s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:08:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e763c2fe-854f-40ea-b103-f87edf76ab44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f5c8f83-4f96-4a8e-b7eb-893e887ad314', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30aef3f7-194d-4dae-8b08-e64456f68232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:36 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Volume volume-8f5c8f83-4f96-4a8e-b7eb-893e887ad314 (8f5c8f83-4f96-4a8e-b7eb-893e887ad314): created successfully
Sep 07 18:08:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30aef3f7-194d-4dae-8b08-e64456f68232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Flow 'volume_create_manager' (820937dd-3fd2-4563-bd96-0c79d26bde0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:08:36 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-fa426bdd-4734-412a-8f4e-ac9e7211bae6 tempest-VolumesTransfersV357Test-1564315180 None] Created volume successfully.
Sep 07 18:08:38 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4fa06f72-b710-4c58-a4f1-db924980bfee tempest-VolumesTransfersV357Test-1844483612 None] Transfer volume completed successfully.
Sep 07 18:08:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-292e0030-f81c-4bcd-86d3-bf96680f906f tempest-VolumesTransfersV357Test-935179417 None] Acquiring lock "cinder-8f5c8f83-4f96-4a8e-b7eb-893e887ad314-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:08:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-292e0030-f81c-4bcd-86d3-bf96680f906f tempest-VolumesTransfersV357Test-935179417 None] Lock "cinder-8f5c8f83-4f96-4a8e-b7eb-893e887ad314-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:08:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-292e0030-f81c-4bcd-86d3-bf96680f906f tempest-VolumesTransfersV357Test-935179417 None] Acquiring lock "cinder-quobyte-8f5c8f83-4f96-4a8e-b7eb-893e887ad314" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:08:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-292e0030-f81c-4bcd-86d3-bf96680f906f tempest-VolumesTransfersV357Test-935179417 None] Lock "cinder-quobyte-8f5c8f83-4f96-4a8e-b7eb-893e887ad314" acquired by "delete_volume" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:08:39 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dd5cee-8602-42b5-b9e0-dec86dfec29b]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:08:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-292e0030-f81c-4bcd-86d3-bf96680f906f tempest-VolumesTransfersV357Test-935179417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8f5c8f83-4f96-4a8e-b7eb-893e887ad314 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:39 devstack sudo[97777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8f5c8f83-4f96-4a8e-b7eb-893e887ad314
Sep 07 18:08:39 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:39 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-292e0030-f81c-4bcd-86d3-bf96680f906f tempest-VolumesTransfersV357Test-935179417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8f5c8f83-4f96-4a8e-b7eb-893e887ad314" returned: 0 in 0.482s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-292e0030-f81c-4bcd-86d3-bf96680f906f tempest-VolumesTransfersV357Test-935179417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8f5c8f83-4f96-4a8e-b7eb-893e887ad314 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:39 devstack sudo[97782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8f5c8f83-4f96-4a8e-b7eb-893e887ad314
Sep 07 18:08:39 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:40 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-292e0030-f81c-4bcd-86d3-bf96680f906f tempest-VolumesTransfersV357Test-935179417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8f5c8f83-4f96-4a8e-b7eb-893e887ad314" returned: 0 in 0.309s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-292e0030-f81c-4bcd-86d3-bf96680f906f tempest-VolumesTransfersV357Test-935179417 None] Lock "cinder-quobyte-8f5c8f83-4f96-4a8e-b7eb-893e887ad314" released by "delete_volume" :: held 0.841s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:08:40 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-292e0030-f81c-4bcd-86d3-bf96680f906f tempest-VolumesTransfersV357Test-935179417 None] Created reservations ['ab19b71e-924c-420e-80a7-4c6834812952', '1b366211-0b55-4041-b01f-f39c465e903d', '96356439-4eae-4dee-98b3-995b87b655df', '8df13337-5440-4799-bfa2-3602a1ac6223'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:08:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-292e0030-f81c-4bcd-86d3-bf96680f906f tempest-VolumesTransfersV357Test-935179417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:08:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-292e0030-f81c-4bcd-86d3-bf96680f906f tempest-VolumesTransfersV357Test-935179417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:08:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-292e0030-f81c-4bcd-86d3-bf96680f906f tempest-VolumesTransfersV357Test-935179417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:08:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-292e0030-f81c-4bcd-86d3-bf96680f906f tempest-VolumesTransfersV357Test-935179417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:08:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-292e0030-f81c-4bcd-86d3-bf96680f906f tempest-VolumesTransfersV357Test-935179417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-292e0030-f81c-4bcd-86d3-bf96680f906f tempest-VolumesTransfersV357Test-935179417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:40 devstack sudo[97785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:08:40 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:40 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-292e0030-f81c-4bcd-86d3-bf96680f906f tempest-VolumesTransfersV357Test-935179417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.340s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:40 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-292e0030-f81c-4bcd-86d3-bf96680f906f tempest-VolumesTransfersV357Test-935179417 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:08:40 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-292e0030-f81c-4bcd-86d3-bf96680f906f tempest-VolumesTransfersV357Test-935179417 None] Deleted volume successfully.
Sep 07 18:08:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-292e0030-f81c-4bcd-86d3-bf96680f906f tempest-VolumesTransfersV357Test-935179417 None] Lock "cinder-8f5c8f83-4f96-4a8e-b7eb-893e887ad314-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:08:41 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:08:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Flow 'volume_create_manager' (146486de-4a93-4516-89a6-2041850c6f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:08:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a07062-50c2-4e26-b06e-459822b3c653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a07062-50c2-4e26-b06e-459822b3c653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1452110034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b196a23-f197-4439-b083-bda5c3bc6319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ac7fe4099b44fdba434e83006cfa93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:08:41Z,use_quota=True,user_id='20c434e886b342b29cb22eb987f71eb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f6bc28-70e7-4443-a25c-413a05b48aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f6bc28-70e7-4443-a25c-413a05b48aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d5e0b90-01e8-4775-824f-062210c22c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d5e0b90-01e8-4775-824f-062210c22c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b196a23-f197-4439-b083-bda5c3bc6319', 'volume_name': 'volume-9b196a23-f197-4439-b083-bda5c3bc6319', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ca9c72-1dcd-4c94-b156-c3eb48661778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ca9c72-1dcd-4c94-b156-c3eb48661778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbcf5df7-f1ce-4975-b493-be69414e3cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:41 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Volume 9b196a23-f197-4439-b083-bda5c3bc6319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b196a23-f197-4439-b083-bda5c3bc6319', 'volume_size': 1}
Sep 07 18:08:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:08:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:08:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1452110034',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b196a23-f197-4439-b083-bda5c3bc6319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47ac7fe4099b44fdba434e83006cfa93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:08:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:08:41Z,use_quota=True,user_id='20c434e886b342b29cb22eb987f71eb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:08:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Creating volume 9b196a23-f197-4439-b083-bda5c3bc6319 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:08:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:08:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:08:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:08:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:08:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:08:41 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:08:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b196a23-f197-4439-b083-bda5c3bc6319 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:41 devstack sudo[97789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b196a23-f197-4439-b083-bda5c3bc6319 1073741824
Sep 07 18:08:41 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:41 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b196a23-f197-4439-b083-bda5c3bc6319 1073741824" returned: 0 in 0.610s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b196a23-f197-4439-b083-bda5c3bc6319 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:42 devstack sudo[97795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b196a23-f197-4439-b083-bda5c3bc6319
Sep 07 18:08:42 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:42 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b196a23-f197-4439-b083-bda5c3bc6319" returned: 0 in 0.337s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:08:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbcf5df7-f1ce-4975-b493-be69414e3cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b196a23-f197-4439-b083-bda5c3bc6319', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1171259d-001d-4cfc-ad3d-bc4e85e0b280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:08:42 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Volume volume-9b196a23-f197-4439-b083-bda5c3bc6319 (9b196a23-f197-4439-b083-bda5c3bc6319): created successfully
Sep 07 18:08:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1171259d-001d-4cfc-ad3d-bc4e85e0b280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:08:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Flow 'volume_create_manager' (146486de-4a93-4516-89a6-2041850c6f9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:08:42 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d185a7a3-276c-4a46-a5cb-fd3e1344f98f tempest-VolumesTransfersV357Test-1564315180 None] Created volume successfully.
Sep 07 18:08:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ac1d6bc7-5380-4215-a264-5541dc2041e1 tempest-VolumesTransfersV357Test-935179417 None] Acquiring lock "cinder-9b196a23-f197-4439-b083-bda5c3bc6319-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:08:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ac1d6bc7-5380-4215-a264-5541dc2041e1 tempest-VolumesTransfersV357Test-935179417 None] Lock "cinder-9b196a23-f197-4439-b083-bda5c3bc6319-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:08:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ac1d6bc7-5380-4215-a264-5541dc2041e1 tempest-VolumesTransfersV357Test-935179417 None] Acquiring lock "cinder-quobyte-9b196a23-f197-4439-b083-bda5c3bc6319" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:08:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ac1d6bc7-5380-4215-a264-5541dc2041e1 tempest-VolumesTransfersV357Test-935179417 None] Lock "cinder-quobyte-9b196a23-f197-4439-b083-bda5c3bc6319" acquired by "delete_volume" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:08:44 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e8ae5f-15df-434e-babd-be7f2db43ce1]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:08:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac1d6bc7-5380-4215-a264-5541dc2041e1 tempest-VolumesTransfersV357Test-935179417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b196a23-f197-4439-b083-bda5c3bc6319 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:44 devstack sudo[97822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b196a23-f197-4439-b083-bda5c3bc6319
Sep 07 18:08:44 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:44 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac1d6bc7-5380-4215-a264-5541dc2041e1 tempest-VolumesTransfersV357Test-935179417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b196a23-f197-4439-b083-bda5c3bc6319" returned: 0 in 0.568s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac1d6bc7-5380-4215-a264-5541dc2041e1 tempest-VolumesTransfersV357Test-935179417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b196a23-f197-4439-b083-bda5c3bc6319 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:44 devstack sudo[97842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b196a23-f197-4439-b083-bda5c3bc6319
Sep 07 18:08:44 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:45 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac1d6bc7-5380-4215-a264-5541dc2041e1 tempest-VolumesTransfersV357Test-935179417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b196a23-f197-4439-b083-bda5c3bc6319" returned: 0 in 0.432s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ac1d6bc7-5380-4215-a264-5541dc2041e1 tempest-VolumesTransfersV357Test-935179417 None] Lock "cinder-quobyte-9b196a23-f197-4439-b083-bda5c3bc6319" released by "delete_volume" :: held 1.093s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:08:45 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-ac1d6bc7-5380-4215-a264-5541dc2041e1 tempest-VolumesTransfersV357Test-935179417 None] Created reservations ['c72a96ec-89d1-44d9-a828-757dbc6b2d50', '7a685e05-5004-4a77-90d4-35fd950d2574', '24d170a7-98b8-420b-8f9e-14ed9d042e49', 'f61ffbfd-9443-4efe-8972-381118962cff'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:08:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ac1d6bc7-5380-4215-a264-5541dc2041e1 tempest-VolumesTransfersV357Test-935179417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:08:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ac1d6bc7-5380-4215-a264-5541dc2041e1 tempest-VolumesTransfersV357Test-935179417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:08:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ac1d6bc7-5380-4215-a264-5541dc2041e1 tempest-VolumesTransfersV357Test-935179417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:08:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ac1d6bc7-5380-4215-a264-5541dc2041e1 tempest-VolumesTransfersV357Test-935179417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:08:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ac1d6bc7-5380-4215-a264-5541dc2041e1 tempest-VolumesTransfersV357Test-935179417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:08:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac1d6bc7-5380-4215-a264-5541dc2041e1 tempest-VolumesTransfersV357Test-935179417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:08:45 devstack sudo[97860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:08:45 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:08:45 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root
Sep 07 18:08:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac1d6bc7-5380-4215-a264-5541dc2041e1 tempest-VolumesTransfersV357Test-935179417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.353s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:08:45 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-ac1d6bc7-5380-4215-a264-5541dc2041e1 tempest-VolumesTransfersV357Test-935179417 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:08:45 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ac1d6bc7-5380-4215-a264-5541dc2041e1 tempest-VolumesTransfersV357Test-935179417 None] Deleted volume successfully.
Sep 07 18:08:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ac1d6bc7-5380-4215-a264-5541dc2041e1 tempest-VolumesTransfersV357Test-935179417 None] Lock "cinder-9b196a23-f197-4439-b083-bda5c3bc6319-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:08:53 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=126,cinder:SELECT=93,cinder:INSERT=27,cinder:DELETE=8 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:08:53 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=94,cinder:INSERT=30,cinder:UPDATE=110,cinder:DELETE=12 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:08:53 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-2cbd7b94-14ff-4f47-b32b-7aec756d2e96 req-ec0e2ac4-da5a-456d-95f8-611e25321198 tempest-AttachVolumeNegativeTest-1258960963 None] Terminate volume connection completed successfully.
Sep 07 18:08:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-2cbd7b94-14ff-4f47-b32b-7aec756d2e96 req-ec0e2ac4-da5a-456d-95f8-611e25321198 tempest-AttachVolumeNegativeTest-1258960963 None] Deleting attachment 6e4ecdc1-f4cf-40d8-a36f-b219e20aa193. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 07 18:09:00 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:09:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:09:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:09:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:09:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:09:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:09:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:09:00 devstack sudo[97894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:09:00 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:09:01 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root
Sep 07 18:09:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.312s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:09:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:09:01 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:09:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 07 18:09:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread info: [<_MainThread(MainThread, started 137533762306176)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137533650971072)>, <Thread(Thread-3 (stat_writer), started daemon 137533647226880)>, <Thread(Rabbit-heartbeat, started daemon 137533647437120)>, <Thread(Thread-5 (_runner), started daemon 137533648120896)>, <Thread(Thread-7 (_runner), started daemon 137533648182592)>, <Thread(fd_logger, started daemon 137533644336576)>, <Thread(privsep_reader, started daemon 137533643255424)>, <Thread(tpool_thread_0, started daemon 137533635446464)>, <Thread(tpool_thread_1, started daemon 137533627053760)>, <Thread(tpool_thread_2, started daemon 137533618661056)>, <Thread(tpool_thread_3, started daemon 137533610251968)>, <Thread(tpool_thread_4, started daemon 137533601842880)>, <Thread(tpool_thread_5, started daemon 137533593433792)>, <Thread(tpool_thread_6, started daemon 137533585024704)>, <Thread(tpool_thread_7, started daemon 137533576615616)>, <Thread(tpool_thread_8, started daemon 137533568206528)>, <Thread(tpool_thread_9, started daemon 137533559797440)>, <Thread(tpool_thread_10, started daemon 137533551388352)>, <Thread(tpool_thread_11, started daemon 137533542979264)>, <Thread(tpool_thread_12, started daemon 137533534570176)>, <Thread(tpool_thread_13, started daemon 137533526161088)>, <Thread(tpool_thread_14, started daemon 137533517752000)>, <Thread(tpool_thread_15, started daemon 137533509342912)>, <Thread(tpool_thread_16, started daemon 137533500933824)>, <Thread(tpool_thread_17, started daemon 137533492524736)>, <Thread(tpool_thread_18, started daemon 137533484115648)>, <Thread(tpool_thread_19, started daemon 137533475706560)>] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 07 18:09:10 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:09:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Flow 'volume_create_manager' (ed9b15be-6a1a-47b5-ae93-31a6fc3b3dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:09:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcee1d7b-dad8-4092-8b06-73b2a9e551f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:09:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcee1d7b-dad8-4092-8b06-73b2a9e551f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2026783043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7bb58f0-6103-4634-b85d-a435eeacddec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61948bf28b114fffb3e4e93e255d240f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:09:10Z,use_quota=True,user_id='e3ef3ec73c8f4ecdbd98029db67dabea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:09:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f92947b-9e0e-4d08-b2ff-20b3c01e3964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:09:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f92947b-9e0e-4d08-b2ff-20b3c01e3964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:09:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5eb6b3-9196-43a1-86d3-ea7bad323319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:09:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5eb6b3-9196-43a1-86d3-ea7bad323319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7bb58f0-6103-4634-b85d-a435eeacddec', 'volume_name': 'volume-c7bb58f0-6103-4634-b85d-a435eeacddec', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:09:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b778ef7-9f50-4164-8817-91048438a59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:09:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b778ef7-9f50-4164-8817-91048438a59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:09:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb0780e-48f8-48d0-82d0-87cc0755d9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:09:10 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Volume c7bb58f0-6103-4634-b85d-a435eeacddec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7bb58f0-6103-4634-b85d-a435eeacddec', 'volume_size': 1}
Sep 07 18:09:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:09:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:09:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2026783043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7bb58f0-6103-4634-b85d-a435eeacddec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61948bf28b114fffb3e4e93e255d240f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:09:10Z,use_quota=True,user_id='e3ef3ec73c8f4ecdbd98029db67dabea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:09:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Creating volume c7bb58f0-6103-4634-b85d-a435eeacddec {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:09:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:09:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:09:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:09:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:09:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:09:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:09:10 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:09:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:09:10 devstack sudo[97955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec 1073741824
Sep 07 18:09:10 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:09:11 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root
Sep 07 18:09:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec 1073741824" returned: 0 in 0.502s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:09:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:09:11 devstack sudo[97961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec
Sep 07 18:09:11 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:09:11 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root
Sep 07 18:09:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec" returned: 0 in 0.274s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:09:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:09:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:09:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdb0780e-48f8-48d0-82d0-87cc0755d9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7bb58f0-6103-4634-b85d-a435eeacddec', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:09:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d01e301-f515-4ccf-ac4b-b8f1a4b31686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:09:11 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Volume volume-c7bb58f0-6103-4634-b85d-a435eeacddec (c7bb58f0-6103-4634-b85d-a435eeacddec): created successfully
Sep 07 18:09:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d01e301-f515-4ccf-ac4b-b8f1a4b31686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:09:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Flow 'volume_create_manager' (ed9b15be-6a1a-47b5-ae93-31a6fc3b3dd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:09:11 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a2f8f0b0-c1a8-4d2f-98ff-6a6b62086306 tempest-VolumesActionsTest-561353297 None] Created volume successfully.
Sep 07 18:09:18 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:09:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Flow 'volume_create_manager' (8028e259-6ec3-4e09-b3ee-8e9dc183b977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:09:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b80fd7-c9f1-4392-b328-4b77184ac62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:09:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b80fd7-c9f1-4392-b328-4b77184ac62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-73812077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0b1e71-b75e-4f24-b72f-921304a6fd7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fda3ab018ed54aedb6af01e609477103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:09:19Z,use_quota=True,user_id='d54f3868131944eca9765f1572f02fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:09:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63aeb603-7b47-4319-81fc-3b7c38378447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:09:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63aeb603-7b47-4319-81fc-3b7c38378447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:09:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a67ed1b-1bac-416e-a04e-8d2e232a0a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:09:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a67ed1b-1bac-416e-a04e-8d2e232a0a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e0b1e71-b75e-4f24-b72f-921304a6fd7b', 'volume_name': 'volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:09:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ad5fa7-2f09-4e69-a80b-9faeaa4197af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:09:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ad5fa7-2f09-4e69-a80b-9faeaa4197af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:09:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f49c0c-7db8-4411-b3ed-034f81144caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:09:18 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Volume 3e0b1e71-b75e-4f24-b72f-921304a6fd7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b', 'volume_size': 1}
Sep 07 18:09:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:09:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:09:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-73812077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0b1e71-b75e-4f24-b72f-921304a6fd7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fda3ab018ed54aedb6af01e609477103',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:09:19Z,use_quota=True,user_id='d54f3868131944eca9765f1572f02fe4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:09:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Creating volume 3e0b1e71-b75e-4f24-b72f-921304a6fd7b {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:09:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:09:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:09:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:09:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:09:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:09:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:09:18 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:09:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:09:18 devstack sudo[97973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b 1073741824
Sep 07 18:09:18 devstack sudo[97973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:09:19 devstack sudo[97973]: pam_unix(sudo:session): session closed for user root
Sep 07 18:09:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b 1073741824" returned: 0 in 0.917s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:09:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:09:19 devstack sudo[98030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b
Sep 07 18:09:19 devstack sudo[98030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:09:20 devstack sudo[98030]: pam_unix(sudo:session): session closed for user root
Sep 07 18:09:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b" returned: 0 in 0.621s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:09:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:09:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:09:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f49c0c-7db8-4411-b3ed-034f81144caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:09:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8cc8395-290f-473f-bea6-ab66d66d8f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:09:20 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Volume volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b (3e0b1e71-b75e-4f24-b72f-921304a6fd7b): created successfully
Sep 07 18:09:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8cc8395-290f-473f-bea6-ab66d66d8f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:09:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Flow 'volume_create_manager' (8028e259-6ec3-4e09-b3ee-8e9dc183b977) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:09:20 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-8053c7f2-cc2a-42ae-ac4e-9a201105c38d tempest-TestImageHashVerification-910762778 None] Created volume successfully.
Sep 07 18:09:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d4458e52-aa00-418b-8aa8-acb7024d58f9 tempest-TestImageHashVerification-910762778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:09:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d4458e52-aa00-418b-8aa8-acb7024d58f9 tempest-TestImageHashVerification-910762778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:09:22 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8139cc5-baf0-4326-b9d4-2f61eea570e3]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:09:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d4458e52-aa00-418b-8aa8-acb7024d58f9 tempest-TestImageHashVerification-910762778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:09:23 devstack sudo[98070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b
Sep 07 18:09:23 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:09:23 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root
Sep 07 18:09:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d4458e52-aa00-418b-8aa8-acb7024d58f9 tempest-TestImageHashVerification-910762778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b" returned: 0 in 1.010s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:09:23 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b398f9cc-07a5-40d3-8338-59b595a241b9]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:09:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d4458e52-aa00-418b-8aa8-acb7024d58f9 tempest-TestImageHashVerification-910762778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:09:23 devstack sudo[98099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b
Sep 07 18:09:23 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:09:24 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root
Sep 07 18:09:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d4458e52-aa00-418b-8aa8-acb7024d58f9 tempest-TestImageHashVerification-910762778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b" returned: 0 in 0.470s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:09:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d4458e52-aa00-418b-8aa8-acb7024d58f9 tempest-TestImageHashVerification-910762778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b /opt/stack/data/cinder/conversion/3e0b1e71-b75e-4f24-b72f-921304a6fd7b.temp_image.b4891fda-77a7-42fd-9fc4-d9f44e93ac589le2jxjz.img {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:09:24 devstack sudo[98104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b /opt/stack/data/cinder/conversion/3e0b1e71-b75e-4f24-b72f-921304a6fd7b.temp_image.b4891fda-77a7-42fd-9fc4-d9f44e93ac589le2jxjz.img
Sep 07 18:09:24 devstack sudo[98104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:09:30 devstack sudo[98104]: pam_unix(sudo:session): session closed for user root
Sep 07 18:09:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d4458e52-aa00-418b-8aa8-acb7024d58f9 tempest-TestImageHashVerification-910762778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b /opt/stack/data/cinder/conversion/3e0b1e71-b75e-4f24-b72f-921304a6fd7b.temp_image.b4891fda-77a7-42fd-9fc4-d9f44e93ac589le2jxjz.img" returned: 0 in 6.499s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:09:30 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e82eac-3766-4098-bc19-9daf45bf0b9c]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:09:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d4458e52-aa00-418b-8aa8-acb7024d58f9 tempest-TestImageHashVerification-910762778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:09:30 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:09:30 devstack sudo[98123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b
Sep 07 18:09:30 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:09:31 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root
Sep 07 18:09:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d4458e52-aa00-418b-8aa8-acb7024d58f9 tempest-TestImageHashVerification-910762778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b" returned: 0 in 1.048s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:09:31 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-d4458e52-aa00-418b-8aa8-acb7024d58f9 tempest-TestImageHashVerification-910762778 None] Image conversion details: src /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b, size 1024.00 MB, duration 6.50 sec, destination /opt/stack/data/cinder/conversion/3e0b1e71-b75e-4f24-b72f-921304a6fd7b.temp_image.b4891fda-77a7-42fd-9fc4-d9f44e93ac589le2jxjz.img {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 07 18:09:31 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-d4458e52-aa00-418b-8aa8-acb7024d58f9 tempest-TestImageHashVerification-910762778 None] Converted 1024.00 MB image at 157.51 MB/s
Sep 07 18:09:31 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-d4458e52-aa00-418b-8aa8-acb7024d58f9 tempest-TestImageHashVerification-910762778 None] b4891fda-77a7-42fd-9fc4-d9f44e93ac58 was raw, no need to convert to raw {{(pid=87269) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Sep 07 18:09:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d992d1cc-5dcc-488b-a4dd-3a320e9d7756 tempest-VolumesActionsTest-561353297 None] Acquiring lock "cinder-c7bb58f0-6103-4634-b85d-a435eeacddec" by "attach_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:09:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d992d1cc-5dcc-488b-a4dd-3a320e9d7756 tempest-VolumesActionsTest-561353297 None] Lock "cinder-c7bb58f0-6103-4634-b85d-a435eeacddec" acquired by "attach_volume" :: waited 0.067s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:09:38 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d992d1cc-5dcc-488b-a4dd-3a320e9d7756 tempest-VolumesActionsTest-561353297 None] Attaching volume c7bb58f0-6103-4634-b85d-a435eeacddec to instance e775f43d-1252-42d9-ad4b-94693c1d2e5d at mountpoint /dev/vdb on host None.
Sep 07 18:09:38 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d992d1cc-5dcc-488b-a4dd-3a320e9d7756 tempest-VolumesActionsTest-561353297 None] Attach volume completed successfully.
Sep 07 18:09:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d992d1cc-5dcc-488b-a4dd-3a320e9d7756 tempest-VolumesActionsTest-561353297 None] Lock "cinder-c7bb58f0-6103-4634-b85d-a435eeacddec" released by "attach_volume" :: held 0.252s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:09:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f446218-2499-47ad-a637-92f1f632dc57 tempest-VolumesActionsTest-561353297 None] Acquiring lock "cinder-c7bb58f0-6103-4634-b85d-a435eeacddec-detach_volume" by "detach_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:09:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f446218-2499-47ad-a637-92f1f632dc57 tempest-VolumesActionsTest-561353297 None] Lock "cinder-c7bb58f0-6103-4634-b85d-a435eeacddec-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:09:38 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3f446218-2499-47ad-a637-92f1f632dc57 tempest-VolumesActionsTest-561353297 None] Detaching volume c7bb58f0-6103-4634-b85d-a435eeacddec from instance e775f43d-1252-42d9-ad4b-94693c1d2e5d.
Sep 07 18:09:38 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3f446218-2499-47ad-a637-92f1f632dc57 tempest-VolumesActionsTest-561353297 None] Detach volume completed successfully.
Sep 07 18:09:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f446218-2499-47ad-a637-92f1f632dc57 tempest-VolumesActionsTest-561353297 None] Lock "cinder-c7bb58f0-6103-4634-b85d-a435eeacddec-detach_volume" released by "detach_volume" :: held 0.139s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:09:48 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=4 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:09:48 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=10,cinder:SELECT=13,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:09:52 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:09:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Flow 'volume_create_manager' (bc692771-7853-4274-b911-c42215e50164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:09:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f466688c-d996-4610-9ca4-7f491a86b17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:09:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f466688c-d996-4610-9ca4-7f491a86b17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-242483948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e988f3-fbad-4ec8-b398-1136c8fd0023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab7b1a0f98b0496da1f4d50da15c2fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:09:53Z,use_quota=True,user_id='205d40ca399e4cbd804a3c7704c5c03d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:09:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6087408c-03fe-4967-b4ce-b21660e974b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:09:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6087408c-03fe-4967-b4ce-b21660e974b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:09:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f9a3e9-f07f-46ea-9d0d-48326acca64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:09:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f9a3e9-f07f-46ea-9d0d-48326acca64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77e988f3-fbad-4ec8-b398-1136c8fd0023', 'volume_name': 'volume-77e988f3-fbad-4ec8-b398-1136c8fd0023', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:09:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fac84a88-509e-4ee7-92f1-65ed753ac1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:09:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fac84a88-509e-4ee7-92f1-65ed753ac1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:09:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689c776f-74f4-4cf1-a653-5c2add158acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:09:52 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Volume 77e988f3-fbad-4ec8-b398-1136c8fd0023: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77e988f3-fbad-4ec8-b398-1136c8fd0023', 'volume_size': 1}
Sep 07 18:09:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:09:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d6fc5c6e-eb24-45d7-8c05-157c291ec073 tempest-VolumesActionsTest-561353297 None] Acquiring lock "cinder-c7bb58f0-6103-4634-b85d-a435eeacddec" by "attach_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:09:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d6fc5c6e-eb24-45d7-8c05-157c291ec073 tempest-VolumesActionsTest-561353297 None] Lock "cinder-c7bb58f0-6103-4634-b85d-a435eeacddec" acquired by "attach_volume" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:09:56 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d6fc5c6e-eb24-45d7-8c05-157c291ec073 tempest-VolumesActionsTest-561353297 None] Attaching volume c7bb58f0-6103-4634-b85d-a435eeacddec to instance e484a1a4-92e0-4e94-9d82-1a15a995350e at mountpoint /dev/vdb on host None.
Sep 07 18:09:56 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d6fc5c6e-eb24-45d7-8c05-157c291ec073 tempest-VolumesActionsTest-561353297 None] Attach volume completed successfully.
Sep 07 18:09:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d6fc5c6e-eb24-45d7-8c05-157c291ec073 tempest-VolumesActionsTest-561353297 None] Lock "cinder-c7bb58f0-6103-4634-b85d-a435eeacddec" released by "attach_volume" :: held 0.167s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:09:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-71a5977d-fed2-4f93-8afc-506a9e9c7c9a tempest-VolumesActionsTest-561353297 None] Acquiring lock "cinder-c7bb58f0-6103-4634-b85d-a435eeacddec-detach_volume" by "detach_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:09:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-71a5977d-fed2-4f93-8afc-506a9e9c7c9a tempest-VolumesActionsTest-561353297 None] Lock "cinder-c7bb58f0-6103-4634-b85d-a435eeacddec-detach_volume" acquired by "detach_volume" :: waited 0.048s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:09:56 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-71a5977d-fed2-4f93-8afc-506a9e9c7c9a tempest-VolumesActionsTest-561353297 None] Detaching volume c7bb58f0-6103-4634-b85d-a435eeacddec from instance e484a1a4-92e0-4e94-9d82-1a15a995350e.
Sep 07 18:09:56 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-71a5977d-fed2-4f93-8afc-506a9e9c7c9a tempest-VolumesActionsTest-561353297 None] Detach volume completed successfully.
Sep 07 18:09:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-71a5977d-fed2-4f93-8afc-506a9e9c7c9a tempest-VolumesActionsTest-561353297 None] Lock "cinder-c7bb58f0-6103-4634-b85d-a435eeacddec-detach_volume" released by "detach_volume" :: held 0.109s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:10:00 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:10:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:10:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:10:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:10:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:10:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:10:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:00 devstack sudo[98485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:10:00 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:01 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.302s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:10:01 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:10:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 07 18:10:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread info: [<_MainThread(MainThread, started 137533762306176)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137533650971072)>, <Thread(Thread-3 (stat_writer), started daemon 137533647226880)>, <Thread(Rabbit-heartbeat, started daemon 137533647437120)>, <Thread(Thread-5 (_runner), started daemon 137533648120896)>, <Thread(Thread-7 (_runner), started daemon 137533648182592)>, <Thread(fd_logger, started daemon 137533644336576)>, <Thread(privsep_reader, started daemon 137533643255424)>, <Thread(tpool_thread_0, started daemon 137533635446464)>, <Thread(tpool_thread_1, started daemon 137533627053760)>, <Thread(tpool_thread_2, started daemon 137533618661056)>, <Thread(tpool_thread_3, started daemon 137533610251968)>, <Thread(tpool_thread_4, started daemon 137533601842880)>, <Thread(tpool_thread_5, started daemon 137533593433792)>, <Thread(tpool_thread_6, started daemon 137533585024704)>, <Thread(tpool_thread_7, started daemon 137533576615616)>, <Thread(tpool_thread_8, started daemon 137533568206528)>, <Thread(tpool_thread_9, started daemon 137533559797440)>, <Thread(tpool_thread_10, started daemon 137533551388352)>, <Thread(tpool_thread_11, started daemon 137533542979264)>, <Thread(tpool_thread_12, started daemon 137533534570176)>, <Thread(tpool_thread_13, started daemon 137533526161088)>, <Thread(tpool_thread_14, started daemon 137533517752000)>, <Thread(tpool_thread_15, started daemon 137533509342912)>, <Thread(tpool_thread_16, started daemon 137533500933824)>, <Thread(tpool_thread_17, started daemon 137533492524736)>, <Thread(tpool_thread_18, started daemon 137533484115648)>, <Thread(tpool_thread_19, started daemon 137533475706560)>] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 07 18:10:01 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:10:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Flow 'volume_create_manager' (99d9eac0-855b-477f-9827-95e6aea75420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:10:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3794771-f695-4798-b345-ee0b30d5d4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:10:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3794771-f695-4798-b345-ee0b30d5d4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1369654882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cebee19-24df-48a7-8e73-3eda8aea7ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c6445e4479a4f25bcce2536b55b37f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:10:02Z,use_quota=True,user_id='06f038df90f74342888199086c12f09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:10:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ba93db-9ff7-48e2-a295-73cf6a9fc07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:10:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99ba93db-9ff7-48e2-a295-73cf6a9fc07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:10:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328111d7-d298-4a6c-b54f-60aa67cf7fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:10:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328111d7-d298-4a6c-b54f-60aa67cf7fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cebee19-24df-48a7-8e73-3eda8aea7ebd', 'volume_name': 'volume-8cebee19-24df-48a7-8e73-3eda8aea7ebd', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:10:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1550f40-00b4-4c8c-afd5-43bc8dfe1e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:10:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1550f40-00b4-4c8c-afd5-43bc8dfe1e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:10:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b738d42-2237-4c36-8a9b-fb40f1ff46b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:10:01 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Volume 8cebee19-24df-48a7-8e73-3eda8aea7ebd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cebee19-24df-48a7-8e73-3eda8aea7ebd', 'volume_size': 1}
Sep 07 18:10:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:10:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d4458e52-aa00-418b-8aa8-acb7024d58f9 tempest-TestImageHashVerification-910762778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 40.220s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:10:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d4458e52-aa00-418b-8aa8-acb7024d58f9 tempest-TestImageHashVerification-910762778 None] Uploaded volume to glance image-id: b4891fda-77a7-42fd-9fc4-d9f44e93ac58. {{(pid=87269) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 07 18:10:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.846s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:10:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-242483948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77e988f3-fbad-4ec8-b398-1136c8fd0023,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab7b1a0f98b0496da1f4d50da15c2fb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:09:53Z,use_quota=True,user_id='205d40ca399e4cbd804a3c7704c5c03d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:10:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Creating volume 77e988f3-fbad-4ec8-b398-1136c8fd0023 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:10:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:10:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:10:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:10:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:10:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:10:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:10:02 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:10:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-77e988f3-fbad-4ec8-b398-1136c8fd0023 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:02 devstack sudo[98489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-77e988f3-fbad-4ec8-b398-1136c8fd0023 1073741824
Sep 07 18:10:02 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:02 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d4458e52-aa00-418b-8aa8-acb7024d58f9 tempest-TestImageHashVerification-910762778 None] Copy volume to image completed successfully.
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-912c36af-ec2b-499c-b736-9e72f3ef2720 tempest-VolumesActionsTest-561353297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:10:03 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-77e988f3-fbad-4ec8-b398-1136c8fd0023 1073741824" returned: 0 in 0.417s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-77e988f3-fbad-4ec8-b398-1136c8fd0023 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:03 devstack sudo[98496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-77e988f3-fbad-4ec8-b398-1136c8fd0023
Sep 07 18:10:03 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:03 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-77e988f3-fbad-4ec8-b398-1136c8fd0023" returned: 0 in 0.272s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.691s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1369654882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cebee19-24df-48a7-8e73-3eda8aea7ebd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c6445e4479a4f25bcce2536b55b37f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:10:02Z,use_quota=True,user_id='06f038df90f74342888199086c12f09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Creating volume 8cebee19-24df-48a7-8e73-3eda8aea7ebd {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:10:03 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8cebee19-24df-48a7-8e73-3eda8aea7ebd 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689c776f-74f4-4cf1-a653-5c2add158acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77e988f3-fbad-4ec8-b398-1136c8fd0023', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:10:03 devstack sudo[98499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8cebee19-24df-48a7-8e73-3eda8aea7ebd 1073741824
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c47ed7-8583-4c89-bd68-ae0bc9cc3be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:10:03 devstack sudo[98499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:03 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Volume volume-77e988f3-fbad-4ec8-b398-1136c8fd0023 (77e988f3-fbad-4ec8-b398-1136c8fd0023): created successfully
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c47ed7-8583-4c89-bd68-ae0bc9cc3be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Flow 'volume_create_manager' (bc692771-7853-4274-b911-c42215e50164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:10:03 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2a7300d2-9de9-499f-a50b-a698a7e2aa84 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Created volume successfully.
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9cd1fb2b-b885-4639-9229-b9b223f569b2 tempest-TestImageHashVerification-910762778 None] Acquiring lock "cinder-3e0b1e71-b75e-4f24-b72f-921304a6fd7b-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9cd1fb2b-b885-4639-9229-b9b223f569b2 tempest-TestImageHashVerification-910762778 None] Lock "cinder-3e0b1e71-b75e-4f24-b72f-921304a6fd7b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9cd1fb2b-b885-4639-9229-b9b223f569b2 tempest-TestImageHashVerification-910762778 None] Acquiring lock "cinder-quobyte-3e0b1e71-b75e-4f24-b72f-921304a6fd7b" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9cd1fb2b-b885-4639-9229-b9b223f569b2 tempest-TestImageHashVerification-910762778 None] Lock "cinder-quobyte-3e0b1e71-b75e-4f24-b72f-921304a6fd7b" acquired by "delete_volume" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[24027dbf-c4cd-49f1-842f-65a600dde6b0]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9cd1fb2b-b885-4639-9229-b9b223f569b2 tempest-TestImageHashVerification-910762778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:03 devstack sudo[98499]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8cebee19-24df-48a7-8e73-3eda8aea7ebd 1073741824" returned: 0 in 0.456s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8cebee19-24df-48a7-8e73-3eda8aea7ebd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:03 devstack sudo[98505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b
Sep 07 18:10:03 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:03 devstack sudo[98506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8cebee19-24df-48a7-8e73-3eda8aea7ebd
Sep 07 18:10:03 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:04 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:04 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8cebee19-24df-48a7-8e73-3eda8aea7ebd" returned: 0 in 0.259s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:10:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:10:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-912c36af-ec2b-499c-b736-9e72f3ef2720 tempest-VolumesActionsTest-561353297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.110s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:10:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9cd1fb2b-b885-4639-9229-b9b223f569b2 tempest-TestImageHashVerification-910762778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b" returned: 0 in 0.364s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9cd1fb2b-b885-4639-9229-b9b223f569b2 tempest-TestImageHashVerification-910762778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:04 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1bf1ea-b884-45be-af49-545174668c75]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:10:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-912c36af-ec2b-499c-b736-9e72f3ef2720 tempest-VolumesActionsTest-561353297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:04 devstack sudo[98514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b
Sep 07 18:10:04 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b738d42-2237-4c36-8a9b-fb40f1ff46b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cebee19-24df-48a7-8e73-3eda8aea7ebd', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:10:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694d3c3a-f377-41a1-af9d-e6f1d198e4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:10:04 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Volume volume-8cebee19-24df-48a7-8e73-3eda8aea7ebd (8cebee19-24df-48a7-8e73-3eda8aea7ebd): created successfully
Sep 07 18:10:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694d3c3a-f377-41a1-af9d-e6f1d198e4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:10:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Flow 'volume_create_manager' (99d9eac0-855b-477f-9827-95e6aea75420) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:10:04 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3e1fb389-bb02-47bb-89d9-e0803c72bc83 tempest-AttachVolumeNegativeTest-1258960963 None] Created volume successfully.
Sep 07 18:10:04 devstack sudo[98515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec
Sep 07 18:10:04 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:04 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9cd1fb2b-b885-4639-9229-b9b223f569b2 tempest-TestImageHashVerification-910762778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3e0b1e71-b75e-4f24-b72f-921304a6fd7b" returned: 0 in 0.353s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9cd1fb2b-b885-4639-9229-b9b223f569b2 tempest-TestImageHashVerification-910762778 None] Lock "cinder-quobyte-3e0b1e71-b75e-4f24-b72f-921304a6fd7b" released by "delete_volume" :: held 0.762s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:10:04 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-912c36af-ec2b-499c-b736-9e72f3ef2720 tempest-VolumesActionsTest-561353297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec" returned: 0 in 0.449s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:04 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-9cd1fb2b-b885-4639-9229-b9b223f569b2 tempest-TestImageHashVerification-910762778 None] Created reservations ['5e9af5ca-da80-4c75-9d8d-da3027257ef0', '89434453-e13f-42fc-8606-e1f30ee0446a', 'ab94ed8d-b683-48b1-9db4-cfc637239c98', '89b3bc0c-88d8-4e4a-b7ad-e6266480f126'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:10:04 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df87700-c940-4ad2-a5d0-d45cd4d90066]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:10:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-912c36af-ec2b-499c-b736-9e72f3ef2720 tempest-VolumesActionsTest-561353297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9cd1fb2b-b885-4639-9229-b9b223f569b2 tempest-TestImageHashVerification-910762778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:10:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9cd1fb2b-b885-4639-9229-b9b223f569b2 tempest-TestImageHashVerification-910762778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:10:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9cd1fb2b-b885-4639-9229-b9b223f569b2 tempest-TestImageHashVerification-910762778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:10:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9cd1fb2b-b885-4639-9229-b9b223f569b2 tempest-TestImageHashVerification-910762778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:10:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9cd1fb2b-b885-4639-9229-b9b223f569b2 tempest-TestImageHashVerification-910762778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:10:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9cd1fb2b-b885-4639-9229-b9b223f569b2 tempest-TestImageHashVerification-910762778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:04 devstack sudo[98561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec
Sep 07 18:10:04 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:04 devstack sudo[98564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:10:04 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:05 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9cd1fb2b-b885-4639-9229-b9b223f569b2 tempest-TestImageHashVerification-910762778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.476s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:05 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-9cd1fb2b-b885-4639-9229-b9b223f569b2 tempest-TestImageHashVerification-910762778 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:10:05 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9cd1fb2b-b885-4639-9229-b9b223f569b2 tempest-TestImageHashVerification-910762778 None] Deleted volume successfully.
Sep 07 18:10:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9cd1fb2b-b885-4639-9229-b9b223f569b2 tempest-TestImageHashVerification-910762778 None] Lock "cinder-3e0b1e71-b75e-4f24-b72f-921304a6fd7b-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:10:05 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-912c36af-ec2b-499c-b736-9e72f3ef2720 tempest-VolumesActionsTest-561353297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec" returned: 0 in 0.718s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-912c36af-ec2b-499c-b736-9e72f3ef2720 tempest-VolumesActionsTest-561353297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec /opt/stack/data/cinder/conversion/c7bb58f0-6103-4634-b85d-a435eeacddec.temp_image.cdbdd2a9-47b1-438c-97ae-13b8cfd1b371ph1uehc3.img {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-57a5d321-e490-494e-9180-902a716324c1 req-018d2887-2b72-434f-9007-747ef3844b3f tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:10:05 devstack sudo[98582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec /opt/stack/data/cinder/conversion/c7bb58f0-6103-4634-b85d-a435eeacddec.temp_image.cdbdd2a9-47b1-438c-97ae-13b8cfd1b371ph1uehc3.img
Sep 07 18:10:05 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-d1d715af-6461-4e22-8fa6-6d4934c20201 req-5e01d700-23e0-452e-bb27-7279f7fbb4f5 tempest-AttachVolumeNegativeTest-1258960963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:10:10 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-912c36af-ec2b-499c-b736-9e72f3ef2720 tempest-VolumesActionsTest-561353297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec /opt/stack/data/cinder/conversion/c7bb58f0-6103-4634-b85d-a435eeacddec.temp_image.cdbdd2a9-47b1-438c-97ae-13b8cfd1b371ph1uehc3.img" returned: 0 in 4.821s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:10 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e37c746-91cd-4378-a9b6-8d30bae21f6c]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:10:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-912c36af-ec2b-499c-b736-9e72f3ef2720 tempest-VolumesActionsTest-561353297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:10 devstack sudo[98606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec
Sep 07 18:10:10 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:10 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-912c36af-ec2b-499c-b736-9e72f3ef2720 tempest-VolumesActionsTest-561353297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec" returned: 0 in 0.627s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:10 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-912c36af-ec2b-499c-b736-9e72f3ef2720 tempest-VolumesActionsTest-561353297 None] Image conversion details: src /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec, size 1024.00 MB, duration 4.82 sec, destination /opt/stack/data/cinder/conversion/c7bb58f0-6103-4634-b85d-a435eeacddec.temp_image.cdbdd2a9-47b1-438c-97ae-13b8cfd1b371ph1uehc3.img {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 07 18:10:10 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-912c36af-ec2b-499c-b736-9e72f3ef2720 tempest-VolumesActionsTest-561353297 None] Converted 1024.00 MB image at 212.36 MB/s
Sep 07 18:10:10 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-912c36af-ec2b-499c-b736-9e72f3ef2720 tempest-VolumesActionsTest-561353297 None] cdbdd2a9-47b1-438c-97ae-13b8cfd1b371 was raw, no need to convert to raw {{(pid=87269) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Sep 07 18:10:20 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=20,cinder:SELECT=20,cinder:DELETE=2,cinder:INSERT=2 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:10:20 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=19,cinder:INSERT=6,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:10:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-912c36af-ec2b-499c-b736-9e72f3ef2720 tempest-VolumesActionsTest-561353297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.018s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:10:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-912c36af-ec2b-499c-b736-9e72f3ef2720 tempest-VolumesActionsTest-561353297 None] Uploaded volume to glance image-id: cdbdd2a9-47b1-438c-97ae-13b8cfd1b371. {{(pid=87269) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 07 18:10:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-57a5d321-e490-494e-9180-902a716324c1 req-018d2887-2b72-434f-9007-747ef3844b3f tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 24.748s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:10:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-57a5d321-e490-494e-9180-902a716324c1 req-018d2887-2b72-434f-9007-747ef3844b3f tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:10:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-d1d715af-6461-4e22-8fa6-6d4934c20201 req-5e01d700-23e0-452e-bb27-7279f7fbb4f5 tempest-AttachVolumeNegativeTest-1258960963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 24.423s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:10:30 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-912c36af-ec2b-499c-b736-9e72f3ef2720 tempest-VolumesActionsTest-561353297 None] Copy volume to image completed successfully.
Sep 07 18:10:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-d1d715af-6461-4e22-8fa6-6d4934c20201 req-5e01d700-23e0-452e-bb27-7279f7fbb4f5 tempest-AttachVolumeNegativeTest-1258960963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:10:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-57a5d321-e490-494e-9180-902a716324c1 req-018d2887-2b72-434f-9007-747ef3844b3f tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d', 'name': 'volume-77e988f3-fbad-4ec8-b398-1136c8fd0023', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8cd8ef5f-cd0e-4a40-b69d-6fcb94d7ce75', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 07 18:10:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-d1d715af-6461-4e22-8fa6-6d4934c20201 req-5e01d700-23e0-452e-bb27-7279f7fbb4f5 tempest-AttachVolumeNegativeTest-1258960963 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d', 'name': 'volume-8cebee19-24df-48a7-8e73-3eda8aea7ebd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dacf54cc-b5b3-4d36-a763-7a591d5c9050', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 07 18:10:30 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-57a5d321-e490-494e-9180-902a716324c1 req-018d2887-2b72-434f-9007-747ef3844b3f tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] attachment_update completed successfully.
Sep 07 18:10:30 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-d1d715af-6461-4e22-8fa6-6d4934c20201 req-5e01d700-23e0-452e-bb27-7279f7fbb4f5 tempest-AttachVolumeNegativeTest-1258960963 None] attachment_update completed successfully.
Sep 07 18:10:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f1992ad1-4966-4bd0-9ee3-ff33d74f7213 tempest-VolumesActionsTest-561353297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:10:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f1992ad1-4966-4bd0-9ee3-ff33d74f7213 tempest-VolumesActionsTest-561353297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:10:31 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[485192ce-2aff-4901-a865-ca88f5e60ed2]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:10:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1992ad1-4966-4bd0-9ee3-ff33d74f7213 tempest-VolumesActionsTest-561353297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:31 devstack sudo[99008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec
Sep 07 18:10:31 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:32 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1992ad1-4966-4bd0-9ee3-ff33d74f7213 tempest-VolumesActionsTest-561353297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec" returned: 0 in 0.473s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:32 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb10bc05-dc9e-43c7-b3b0-08a3629af5cb]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:10:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1992ad1-4966-4bd0-9ee3-ff33d74f7213 tempest-VolumesActionsTest-561353297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:32 devstack sudo[99013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec
Sep 07 18:10:32 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:32 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1992ad1-4966-4bd0-9ee3-ff33d74f7213 tempest-VolumesActionsTest-561353297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec" returned: 0 in 0.473s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1992ad1-4966-4bd0-9ee3-ff33d74f7213 tempest-VolumesActionsTest-561353297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec /opt/stack/data/cinder/conversion/c7bb58f0-6103-4634-b85d-a435eeacddec.temp_image.bc1cc212-12cd-49c0-a81c-648acc492196dru8zte_.img {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:32 devstack sudo[99020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec /opt/stack/data/cinder/conversion/c7bb58f0-6103-4634-b85d-a435eeacddec.temp_image.bc1cc212-12cd-49c0-a81c-648acc492196dru8zte_.img
Sep 07 18:10:32 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:32 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-90cf6ea0-d999-438b-bc7d-7ff40cd95e81 req-a74972ab-f456-4832-b312-860247af29d6 tempest-AttachVolumeNegativeTest-1258960963 None] Terminate volume connection completed successfully.
Sep 07 18:10:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-90cf6ea0-d999-438b-bc7d-7ff40cd95e81 req-a74972ab-f456-4832-b312-860247af29d6 tempest-AttachVolumeNegativeTest-1258960963 None] Deleting attachment dacf54cc-b5b3-4d36-a763-7a591d5c9050. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 07 18:10:34 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-d143372f-f308-4045-abc3-4897bb947a8e req-42e3a22a-0dde-4ddb-9eaf-0aabdd96c021 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Terminate volume connection completed successfully.
Sep 07 18:10:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-d143372f-f308-4045-abc3-4897bb947a8e req-42e3a22a-0dde-4ddb-9eaf-0aabdd96c021 tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Deleting attachment 8cd8ef5f-cd0e-4a40-b69d-6fcb94d7ce75. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 07 18:10:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1eb84003-8700-4cd4-b599-63cc751ac47e tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Acquiring lock "cinder-77e988f3-fbad-4ec8-b398-1136c8fd0023-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:10:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1eb84003-8700-4cd4-b599-63cc751ac47e tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Lock "cinder-77e988f3-fbad-4ec8-b398-1136c8fd0023-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:10:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1eb84003-8700-4cd4-b599-63cc751ac47e tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Acquiring lock "cinder-quobyte-77e988f3-fbad-4ec8-b398-1136c8fd0023" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:10:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1eb84003-8700-4cd4-b599-63cc751ac47e tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Lock "cinder-quobyte-77e988f3-fbad-4ec8-b398-1136c8fd0023" acquired by "delete_volume" :: waited 0.056s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:10:36 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c59f42d-6a85-4226-89be-960c62d58b94]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:10:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1eb84003-8700-4cd4-b599-63cc751ac47e tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-77e988f3-fbad-4ec8-b398-1136c8fd0023 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:37 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:10:37 devstack sudo[99083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-77e988f3-fbad-4ec8-b398-1136c8fd0023
Sep 07 18:10:37 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Flow 'volume_create_manager' (401f386d-755b-431f-81e7-8cd408107c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:10:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7d1d0e-94f5-46e9-be0c-49923a21dbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:10:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7d1d0e-94f5-46e9-be0c-49923a21dbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd53eb2-2b9b-489f-ba42-57c543e27342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3641485185e4ad692a670b2ba4d85a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:10:37Z,use_quota=True,user_id='1987a8d2eb6c474d860707b53390714f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c08494e-ad52-45cf-b90f-82c7bbc17698),volume_type_id=7c08494e-ad52-45cf-b90f-82c7bbc17698)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:10:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af03411-6a15-4109-8a01-2a10d3f5c053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:10:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af03411-6a15-4109-8a01-2a10d3f5c053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:10:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765ed19f-4204-41a6-98aa-8e8ddbc5c9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:10:37 devstack cinder-volume[87269]: DEBUG cinder.image.glance [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Creating Keystone auth plugin from conf {{(pid=87269) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 07 18:10:38 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1eb84003-8700-4cd4-b599-63cc751ac47e tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-77e988f3-fbad-4ec8-b398-1136c8fd0023" returned: 0 in 1.202s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1eb84003-8700-4cd4-b599-63cc751ac47e tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-77e988f3-fbad-4ec8-b398-1136c8fd0023 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:38 devstack sudo[99091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-77e988f3-fbad-4ec8-b398-1136c8fd0023
Sep 07 18:10:38 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765ed19f-4204-41a6-98aa-8e8ddbc5c9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2cd53eb2-2b9b-489f-ba42-57c543e27342', 'volume_name': 'volume-2cd53eb2-2b9b-489f-ba42-57c543e27342', 'volume_size': 1, 'image_id': '6b554f6f-87de-4cd3-b0d8-8f3c22d6c228', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b554f6f-87de-4cd3-b0d8-8f3c22d6c228', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5b7fc455352f8e85a87cfdaf0df0e455', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a3641485185e4ad692a670b2ba4d85a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4a711cea7c577d18467c698f4bb199dbf7d78d02d6a28a22fca041eab1909959bee1a7794d20159c36d69a4c0fa4397ed74bb06ba818d941eb8bc33ca0ae1e0e', 'id': '6b554f6f-87de-4cd3-b0d8-8f3c22d6c228', 'created_at': datetime.datetime(2026, 9, 7, 16, 10, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 16, 10, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b554f6f-87de-4cd3-b0d8-8f3c22d6c228/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d160ba67980>}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:10:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb4d3de-3120-4454-868c-dba10386e7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:10:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eb4d3de-3120-4454-868c-dba10386e7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:10:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01bec3b-fb48-4093-9097-0894669eb3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:10:38 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Volume 2cd53eb2-2b9b-489f-ba42-57c543e27342: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2cd53eb2-2b9b-489f-ba42-57c543e27342', 'volume_size': 1, 'image_id': '6b554f6f-87de-4cd3-b0d8-8f3c22d6c228', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b554f6f-87de-4cd3-b0d8-8f3c22d6c228', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5b7fc455352f8e85a87cfdaf0df0e455', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a3641485185e4ad692a670b2ba4d85a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4a711cea7c577d18467c698f4bb199dbf7d78d02d6a28a22fca041eab1909959bee1a7794d20159c36d69a4c0fa4397ed74bb06ba818d941eb8bc33ca0ae1e0e', 'id': '6b554f6f-87de-4cd3-b0d8-8f3c22d6c228', 'created_at': datetime.datetime(2026, 9, 7, 16, 10, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 16, 10, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b554f6f-87de-4cd3-b0d8-8f3c22d6c228/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d160ba67980>}
Sep 07 18:10:38 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Trying to clone 2cd53eb2-2b9b-489f-ba42-57c543e27342 from image 6b554f6f-87de-4cd3-b0d8-8f3c22d6c228 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6b554f6f-87de-4cd3-b0d8-8f3c22d6c228', 'metadata': {}}]). {{(pid=87269) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 07 18:10:38 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_hnr7g6rzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 07 18:10:38 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Image download 0.00 MB at 0.00 MB/s
Sep 07 18:10:38 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1eb84003-8700-4cd4-b599-63cc751ac47e tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-77e988f3-fbad-4ec8-b398-1136c8fd0023" returned: 0 in 0.788s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1eb84003-8700-4cd4-b599-63cc751ac47e tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Lock "cinder-quobyte-77e988f3-fbad-4ec8-b398-1136c8fd0023" released by "delete_volume" :: held 2.092s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:10:38 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1992ad1-4966-4bd0-9ee3-ff33d74f7213 tempest-VolumesActionsTest-561353297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec /opt/stack/data/cinder/conversion/c7bb58f0-6103-4634-b85d-a435eeacddec.temp_image.bc1cc212-12cd-49c0-a81c-648acc492196dru8zte_.img" returned: 0 in 6.283s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:38 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2252947c-1190-4072-a639-9037449ff42b]: (4, 'raw') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:10:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_hnr7g6rzdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:38 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e18fe8d-a8f2-434f-8105-499a595eea5e]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:10:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1992ad1-4966-4bd0-9ee3-ff33d74f7213 tempest-VolumesActionsTest-561353297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:39 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-1eb84003-8700-4cd4-b599-63cc751ac47e tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Created reservations ['31409aba-3759-433e-aa53-de90b7ea6d7d', '4d60f877-a226-46d0-bc72-5eef0afff68f', '30843dec-254d-4d43-b3f2-061129a9c958', '2cfdf86a-e6b6-4031-9494-407cc950d7ff'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:10:39 devstack sudo[99096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_hnr7g6rzdevstack@QuobyteHD
Sep 07 18:10:39 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:39 devstack sudo[99097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec
Sep 07 18:10:39 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:39 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_hnr7g6rzdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_hnr7g6rzdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:39 devstack sudo[99104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_hnr7g6rzdevstack@QuobyteHD
Sep 07 18:10:39 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:39 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1992ad1-4966-4bd0-9ee3-ff33d74f7213 tempest-VolumesActionsTest-561353297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec" returned: 0 in 0.614s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:39 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-f1992ad1-4966-4bd0-9ee3-ff33d74f7213 tempest-VolumesActionsTest-561353297 None] Image conversion details: src /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec, size 1024.00 MB, duration 6.28 sec, destination /opt/stack/data/cinder/conversion/c7bb58f0-6103-4634-b85d-a435eeacddec.temp_image.bc1cc212-12cd-49c0-a81c-648acc492196dru8zte_.img {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 07 18:10:39 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-f1992ad1-4966-4bd0-9ee3-ff33d74f7213 tempest-VolumesActionsTest-561353297 None] Converted 1024.00 MB image at 162.96 MB/s
Sep 07 18:10:39 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-f1992ad1-4966-4bd0-9ee3-ff33d74f7213 tempest-VolumesActionsTest-561353297 None] bc1cc212-12cd-49c0-a81c-648acc492196 was raw, converting to qcow2 {{(pid=87269) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Sep 07 18:10:39 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4bd0643-54e1-4c30-a38b-5a65334d6fa8]: (4, 'raw') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:10:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1992ad1-4966-4bd0-9ee3-ff33d74f7213 tempest-VolumesActionsTest-561353297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c7bb58f0-6103-4634-b85d-a435eeacddec.temp_image.bc1cc212-12cd-49c0-a81c-648acc492196dru8zte_.img {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1eb84003-8700-4cd4-b599-63cc751ac47e tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:10:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1eb84003-8700-4cd4-b599-63cc751ac47e tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:10:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1eb84003-8700-4cd4-b599-63cc751ac47e tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:10:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1eb84003-8700-4cd4-b599-63cc751ac47e tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:10:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1eb84003-8700-4cd4-b599-63cc751ac47e tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:10:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1eb84003-8700-4cd4-b599-63cc751ac47e tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:39 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_hnr7g6rzdevstack@QuobyteHD" returned: 1 in 0.362s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_hnr7g6rzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 07 18:10:39 devstack sudo[99111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:10:39 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:39 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Temporary image 6b554f6f-87de-4cd3-b0d8-8f3c22d6c228 is fetched for user 1987a8d2eb6c474d860707b53390714f. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 07 18:10:39 devstack sudo[99108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c7bb58f0-6103-4634-b85d-a435eeacddec.temp_image.bc1cc212-12cd-49c0-a81c-648acc492196dru8zte_.img
Sep 07 18:10:39 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:39 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bad74a-9d60-4828-9c07-02cdbbbf8ff0]: (4, 'raw') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:10:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_hnr7g6rzdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:39 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1eb84003-8700-4cd4-b599-63cc751ac47e tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.283s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:39 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-1eb84003-8700-4cd4-b599-63cc751ac47e tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:10:39 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-1eb84003-8700-4cd4-b599-63cc751ac47e tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Deleted volume successfully.
Sep 07 18:10:39 devstack sudo[99114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_hnr7g6rzdevstack@QuobyteHD
Sep 07 18:10:39 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1eb84003-8700-4cd4-b599-63cc751ac47e tempest-TestServerVolumeAttachScenarioOldVersion-376941723 None] Lock "cinder-77e988f3-fbad-4ec8-b398-1136c8fd0023-delete_volume" released by "delete_volume" :: held 3.338s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:10:40 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1992ad1-4966-4bd0-9ee3-ff33d74f7213 tempest-VolumesActionsTest-561353297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c7bb58f0-6103-4634-b85d-a435eeacddec.temp_image.bc1cc212-12cd-49c0-a81c-648acc492196dru8zte_.img" returned: 0 in 0.402s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1992ad1-4966-4bd0-9ee3-ff33d74f7213 tempest-VolumesActionsTest-561353297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c7bb58f0-6103-4634-b85d-a435eeacddec.temp_image.bc1cc212-12cd-49c0-a81c-648acc492196dru8zte_.img {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:40 devstack sudo[99119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c7bb58f0-6103-4634-b85d-a435eeacddec.temp_image.bc1cc212-12cd-49c0-a81c-648acc492196dru8zte_.img
Sep 07 18:10:40 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:40 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_hnr7g6rzdevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_hnr7g6rzdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:40 devstack sudo[99123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_hnr7g6rzdevstack@QuobyteHD
Sep 07 18:10:40 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:40 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1992ad1-4966-4bd0-9ee3-ff33d74f7213 tempest-VolumesActionsTest-561353297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c7bb58f0-6103-4634-b85d-a435eeacddec.temp_image.bc1cc212-12cd-49c0-a81c-648acc492196dru8zte_.img" returned: 1 in 0.492s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1992ad1-4966-4bd0-9ee3-ff33d74f7213 tempest-VolumesActionsTest-561353297 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c7bb58f0-6103-4634-b85d-a435eeacddec.temp_image.bc1cc212-12cd-49c0-a81c-648acc492196dru8zte_.img' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 07 18:10:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1992ad1-4966-4bd0-9ee3-ff33d74f7213 tempest-VolumesActionsTest-561353297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c7bb58f0-6103-4634-b85d-a435eeacddec.temp_image.bc1cc212-12cd-49c0-a81c-648acc492196dru8zte_.img /opt/stack/data/cinder/conversion/vol_upload_im623z4d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:40 devstack sudo[99129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c7bb58f0-6103-4634-b85d-a435eeacddec.temp_image.bc1cc212-12cd-49c0-a81c-648acc492196dru8zte_.img /opt/stack/data/cinder/conversion/vol_upload_im623z4d
Sep 07 18:10:40 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:40 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_hnr7g6rzdevstack@QuobyteHD" returned: 1 in 0.444s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_hnr7g6rzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 07 18:10:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:10:41 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1992ad1-4966-4bd0-9ee3-ff33d74f7213 tempest-VolumesActionsTest-561353297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c7bb58f0-6103-4634-b85d-a435eeacddec.temp_image.bc1cc212-12cd-49c0-a81c-648acc492196dru8zte_.img /opt/stack/data/cinder/conversion/vol_upload_im623z4d" returned: 0 in 0.488s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:41 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-f1992ad1-4966-4bd0-9ee3-ff33d74f7213 tempest-VolumesActionsTest-561353297 None] Image conversion details: src /opt/stack/data/cinder/conversion/c7bb58f0-6103-4634-b85d-a435eeacddec.temp_image.bc1cc212-12cd-49c0-a81c-648acc492196dru8zte_.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_im623z4d {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 07 18:10:41 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-f1992ad1-4966-4bd0-9ee3-ff33d74f7213 tempest-VolumesActionsTest-561353297 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 07 18:10:41 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24a8298-e644-40f0-b494-b1a3b7bdec0f]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:10:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1992ad1-4966-4bd0-9ee3-ff33d74f7213 tempest-VolumesActionsTest-561353297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_im623z4d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:41 devstack sudo[99157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_im623z4d
Sep 07 18:10:41 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:41 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f1992ad1-4966-4bd0-9ee3-ff33d74f7213 tempest-VolumesActionsTest-561353297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_im623z4d" returned: 0 in 0.407s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f1992ad1-4966-4bd0-9ee3-ff33d74f7213 tempest-VolumesActionsTest-561353297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.368s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:10:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f1992ad1-4966-4bd0-9ee3-ff33d74f7213 tempest-VolumesActionsTest-561353297 None] Uploaded volume to glance image-id: bc1cc212-12cd-49c0-a81c-648acc492196. {{(pid=87269) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 07 18:10:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.323s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:10:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd53eb2-2b9b-489f-ba42-57c543e27342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3641485185e4ad692a670b2ba4d85a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:10:37Z,use_quota=True,user_id='1987a8d2eb6c474d860707b53390714f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7c08494e-ad52-45cf-b90f-82c7bbc17698),volume_type_id=7c08494e-ad52-45cf-b90f-82c7bbc17698)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:10:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Creating volume 2cd53eb2-2b9b-489f-ba42-57c543e27342 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:10:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:10:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:10:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:10:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:10:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:10:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:10:43 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:10:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2cd53eb2-2b9b-489f-ba42-57c543e27342 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:43 devstack sudo[99166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2cd53eb2-2b9b-489f-ba42-57c543e27342 1073741824
Sep 07 18:10:43 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:43 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f1992ad1-4966-4bd0-9ee3-ff33d74f7213 tempest-VolumesActionsTest-561353297 None] Copy volume to image completed successfully.
Sep 07 18:10:43 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2cd53eb2-2b9b-489f-ba42-57c543e27342 1073741824" returned: 0 in 0.658s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2cd53eb2-2b9b-489f-ba42-57c543e27342 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:43 devstack sudo[99172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2cd53eb2-2b9b-489f-ba42-57c543e27342
Sep 07 18:10:43 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:44 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2cd53eb2-2b9b-489f-ba42-57c543e27342" returned: 0 in 0.295s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:10:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:10:44 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Attempting download of 6b554f6f-87de-4cd3-b0d8-8f3c22d6c228 ((None, [{'url': 'file:///opt/stack/data/glance/images/6b554f6f-87de-4cd3-b0d8-8f3c22d6c228', 'metadata': {}}])) to volume 2cd53eb2-2b9b-489f-ba42-57c543e27342. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 07 18:10:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-03700859-bf2e-4e3d-bf7d-e75dc6ef0a44 tempest-VolumesActionsTest-561353297 None] Acquiring lock "cinder-c7bb58f0-6103-4634-b85d-a435eeacddec-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:10:44 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[612760df-064b-4f15-aaef-b8db0ac0557a]: (4, 'raw') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:10:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_4yvs5g3o {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-03700859-bf2e-4e3d-bf7d-e75dc6ef0a44 tempest-VolumesActionsTest-561353297 None] Lock "cinder-c7bb58f0-6103-4634-b85d-a435eeacddec-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:10:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-03700859-bf2e-4e3d-bf7d-e75dc6ef0a44 tempest-VolumesActionsTest-561353297 None] Acquiring lock "cinder-quobyte-c7bb58f0-6103-4634-b85d-a435eeacddec" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:10:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-03700859-bf2e-4e3d-bf7d-e75dc6ef0a44 tempest-VolumesActionsTest-561353297 None] Lock "cinder-quobyte-c7bb58f0-6103-4634-b85d-a435eeacddec" acquired by "delete_volume" :: waited 0.030s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:10:44 devstack sudo[99175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_4yvs5g3o
Sep 07 18:10:44 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:44 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f213ecd-f40d-41a2-a410-6303b9d29fba]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:10:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-03700859-bf2e-4e3d-bf7d-e75dc6ef0a44 tempest-VolumesActionsTest-561353297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:44 devstack sudo[99177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec
Sep 07 18:10:44 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:44 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_4yvs5g3o" returned: 0 in 0.376s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_4yvs5g3o {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:44 devstack sudo[99181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_4yvs5g3o
Sep 07 18:10:44 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:44 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-03700859-bf2e-4e3d-bf7d-e75dc6ef0a44 tempest-VolumesActionsTest-561353297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec" returned: 0 in 0.494s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-03700859-bf2e-4e3d-bf7d-e75dc6ef0a44 tempest-VolumesActionsTest-561353297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:44 devstack sudo[99186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec
Sep 07 18:10:44 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:44 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_4yvs5g3o" returned: 1 in 0.397s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_4yvs5g3o' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 07 18:10:44 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa16b46c-e6e7-4c7d-9dd8-e8932c3d080c]: (4, 'raw') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:10:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_hnr7g6rzdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:45 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-03700859-bf2e-4e3d-bf7d-e75dc6ef0a44 tempest-VolumesActionsTest-561353297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c7bb58f0-6103-4634-b85d-a435eeacddec" returned: 0 in 0.259s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:45 devstack sudo[99190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_hnr7g6rzdevstack@QuobyteHD
Sep 07 18:10:45 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-03700859-bf2e-4e3d-bf7d-e75dc6ef0a44 tempest-VolumesActionsTest-561353297 None] Lock "cinder-quobyte-c7bb58f0-6103-4634-b85d-a435eeacddec" released by "delete_volume" :: held 0.837s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:10:45 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-03700859-bf2e-4e3d-bf7d-e75dc6ef0a44 tempest-VolumesActionsTest-561353297 None] Created reservations ['7eb70962-90d3-4c93-9234-e0ae6bd482a8', 'ad846703-2693-4860-abe1-44cb338e7e56', '37456a8b-e00d-4f3f-a783-6e0fe59c72fb', 'a8cf5b09-5029-46e4-b2c0-fbe9388da134'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:10:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-03700859-bf2e-4e3d-bf7d-e75dc6ef0a44 tempest-VolumesActionsTest-561353297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:10:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-03700859-bf2e-4e3d-bf7d-e75dc6ef0a44 tempest-VolumesActionsTest-561353297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:10:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-03700859-bf2e-4e3d-bf7d-e75dc6ef0a44 tempest-VolumesActionsTest-561353297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:10:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-03700859-bf2e-4e3d-bf7d-e75dc6ef0a44 tempest-VolumesActionsTest-561353297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:10:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-03700859-bf2e-4e3d-bf7d-e75dc6ef0a44 tempest-VolumesActionsTest-561353297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:10:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-03700859-bf2e-4e3d-bf7d-e75dc6ef0a44 tempest-VolumesActionsTest-561353297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:45 devstack sudo[99196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:10:45 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:45 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_hnr7g6rzdevstack@QuobyteHD" returned: 0 in 0.456s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_hnr7g6rzdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:45 devstack sudo[99200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_hnr7g6rzdevstack@QuobyteHD
Sep 07 18:10:45 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:45 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-03700859-bf2e-4e3d-bf7d-e75dc6ef0a44 tempest-VolumesActionsTest-561353297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.334s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:45 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-03700859-bf2e-4e3d-bf7d-e75dc6ef0a44 tempest-VolumesActionsTest-561353297 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:10:45 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-03700859-bf2e-4e3d-bf7d-e75dc6ef0a44 tempest-VolumesActionsTest-561353297 None] Deleted volume successfully.
Sep 07 18:10:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-03700859-bf2e-4e3d-bf7d-e75dc6ef0a44 tempest-VolumesActionsTest-561353297 None] Lock "cinder-c7bb58f0-6103-4634-b85d-a435eeacddec-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:10:45 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_hnr7g6rzdevstack@QuobyteHD" returned: 1 in 0.444s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_hnr7g6rzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 07 18:10:45 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] 6b554f6f-87de-4cd3-b0d8-8f3c22d6c228 was raw, converting to qcow2 {{(pid=87269) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 07 18:10:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_hnr7g6rzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2cd53eb2-2b9b-489f-ba42-57c543e27342 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:45 devstack sudo[99206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_hnr7g6rzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2cd53eb2-2b9b-489f-ba42-57c543e27342
Sep 07 18:10:45 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:46 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_hnr7g6rzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2cd53eb2-2b9b-489f-ba42-57c543e27342" returned: 0 in 0.731s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:46 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6b554f6f-87de-4cd3-b0d8-8f3c22d6c228_hnr7g6rzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2cd53eb2-2b9b-489f-ba42-57c543e27342 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 07 18:10:46 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Converted 0.00 MB image at 0.00 MB/s
Sep 07 18:10:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2cd53eb2-2b9b-489f-ba42-57c543e27342 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:46 devstack sudo[99216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2cd53eb2-2b9b-489f-ba42-57c543e27342 1G
Sep 07 18:10:46 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:47 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2cd53eb2-2b9b-489f-ba42-57c543e27342 1G" returned: 0 in 0.444s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:47 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Downloaded image 6b554f6f-87de-4cd3-b0d8-8f3c22d6c228 ((None, [{'url': 'file:///opt/stack/data/glance/images/6b554f6f-87de-4cd3-b0d8-8f3c22d6c228', 'metadata': {}}])) to volume 2cd53eb2-2b9b-489f-ba42-57c543e27342 successfully. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 07 18:10:47 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Temporary image 6b554f6f-87de-4cd3-b0d8-8f3c22d6c228 for user 1987a8d2eb6c474d860707b53390714f is deleted. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 07 18:10:47 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Marking volume 2cd53eb2-2b9b-489f-ba42-57c543e27342 as bootable. {{(pid=87269) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 07 18:10:47 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Copying metadata from image 6b554f6f-87de-4cd3-b0d8-8f3c22d6c228 to 2cd53eb2-2b9b-489f-ba42-57c543e27342. {{(pid=87269) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 07 18:10:47 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Creating volume glance metadata for volume 2cd53eb2-2b9b-489f-ba42-57c543e27342 backed by image 6b554f6f-87de-4cd3-b0d8-8f3c22d6c228 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6b554f6f-87de-4cd3-b0d8-8f3c22d6c228', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5b7fc455352f8e85a87cfdaf0df0e455', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87269) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 07 18:10:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a01bec3b-fb48-4093-9097-0894669eb3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cd53eb2-2b9b-489f-ba42-57c543e27342', 'volume_size': 1, 'image_id': '6b554f6f-87de-4cd3-b0d8-8f3c22d6c228', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6b554f6f-87de-4cd3-b0d8-8f3c22d6c228', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5b7fc455352f8e85a87cfdaf0df0e455', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a3641485185e4ad692a670b2ba4d85a2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4a711cea7c577d18467c698f4bb199dbf7d78d02d6a28a22fca041eab1909959bee1a7794d20159c36d69a4c0fa4397ed74bb06ba818d941eb8bc33ca0ae1e0e', 'id': '6b554f6f-87de-4cd3-b0d8-8f3c22d6c228', 'created_at': datetime.datetime(2026, 9, 7, 16, 10, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 16, 10, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6b554f6f-87de-4cd3-b0d8-8f3c22d6c228/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d160ba67980>}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:10:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb504eef-e719-4bb2-90f8-025413330715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:10:47 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Volume volume-2cd53eb2-2b9b-489f-ba42-57c543e27342 (2cd53eb2-2b9b-489f-ba42-57c543e27342): created successfully
Sep 07 18:10:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb504eef-e719-4bb2-90f8-025413330715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:10:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Flow 'volume_create_manager' (401f386d-755b-431f-81e7-8cd408107c73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:10:47 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-6e972fe2-7115-4a60-9aec-aabae722cf06 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Created volume successfully.
Sep 07 18:10:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1b30d26c-71ca-4226-a6ff-5bd526c09ce1 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Acquiring lock "cinder-2cd53eb2-2b9b-489f-ba42-57c543e27342-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:10:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1b30d26c-71ca-4226-a6ff-5bd526c09ce1 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Lock "cinder-2cd53eb2-2b9b-489f-ba42-57c543e27342-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:10:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1b30d26c-71ca-4226-a6ff-5bd526c09ce1 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Acquiring lock "cinder-quobyte-2cd53eb2-2b9b-489f-ba42-57c543e27342" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:10:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1b30d26c-71ca-4226-a6ff-5bd526c09ce1 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Lock "cinder-quobyte-2cd53eb2-2b9b-489f-ba42-57c543e27342" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:10:48 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8165f138-58f3-415b-9956-c7e307d78e17]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:10:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1b30d26c-71ca-4226-a6ff-5bd526c09ce1 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2cd53eb2-2b9b-489f-ba42-57c543e27342 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:48 devstack sudo[99236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2cd53eb2-2b9b-489f-ba42-57c543e27342
Sep 07 18:10:48 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:48 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1b30d26c-71ca-4226-a6ff-5bd526c09ce1 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2cd53eb2-2b9b-489f-ba42-57c543e27342" returned: 0 in 0.378s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1b30d26c-71ca-4226-a6ff-5bd526c09ce1 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2cd53eb2-2b9b-489f-ba42-57c543e27342 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:48 devstack sudo[99244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2cd53eb2-2b9b-489f-ba42-57c543e27342
Sep 07 18:10:48 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:48 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1b30d26c-71ca-4226-a6ff-5bd526c09ce1 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2cd53eb2-2b9b-489f-ba42-57c543e27342" returned: 0 in 0.344s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1b30d26c-71ca-4226-a6ff-5bd526c09ce1 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Lock "cinder-quobyte-2cd53eb2-2b9b-489f-ba42-57c543e27342" released by "delete_volume" :: held 0.770s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:10:48 devstack cinder-volume[87269]: WARNING cinder.quota [None req-1b30d26c-71ca-4226-a6ff-5bd526c09ce1 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:10:48 devstack cinder-volume[87269]: WARNING cinder.quota [None req-1b30d26c-71ca-4226-a6ff-5bd526c09ce1 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:10:48 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-1b30d26c-71ca-4226-a6ff-5bd526c09ce1 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Created reservations ['bc248603-df20-4d28-886d-2a321b01c1d0', '7ead2226-f6d7-459d-aed2-6cafd74afcc3', '74a11a8a-4e06-4be9-bde8-9b53c85b78a3', 'd2b6e900-84db-4581-9115-19a2fe9b1aa4'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:10:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1b30d26c-71ca-4226-a6ff-5bd526c09ce1 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:10:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1b30d26c-71ca-4226-a6ff-5bd526c09ce1 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:10:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1b30d26c-71ca-4226-a6ff-5bd526c09ce1 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:10:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1b30d26c-71ca-4226-a6ff-5bd526c09ce1 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:10:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1b30d26c-71ca-4226-a6ff-5bd526c09ce1 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:10:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1b30d26c-71ca-4226-a6ff-5bd526c09ce1 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:10:49 devstack sudo[99247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:10:49 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:10:49 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root
Sep 07 18:10:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1b30d26c-71ca-4226-a6ff-5bd526c09ce1 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.277s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:10:49 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-1b30d26c-71ca-4226-a6ff-5bd526c09ce1 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:10:49 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-1b30d26c-71ca-4226-a6ff-5bd526c09ce1 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Deleted volume successfully.
Sep 07 18:10:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1b30d26c-71ca-4226-a6ff-5bd526c09ce1 tempest-VolumeAndVolumeTypeFromImageTest-1271378679 None] Lock "cinder-2cd53eb2-2b9b-489f-ba42-57c543e27342-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:10:59 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=42,cinder:UPDATE=38,cinder:INSERT=10,cinder:DELETE=1 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:10:59 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=36,cinder:UPDATE=28,cinder:INSERT=13,cinder:DELETE=3 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:11:00 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:11:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:11:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:11:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:00 devstack sudo[99327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:11:00 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:01 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.414s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:11:01 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:11:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 07 18:11:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread info: [<_MainThread(MainThread, started 137533762306176)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137533650971072)>, <Thread(Thread-3 (stat_writer), started daemon 137533647226880)>, <Thread(Rabbit-heartbeat, started daemon 137533647437120)>, <Thread(Thread-5 (_runner), started daemon 137533648120896)>, <Thread(Thread-7 (_runner), started daemon 137533648182592)>, <Thread(fd_logger, started daemon 137533644336576)>, <Thread(privsep_reader, started daemon 137533643255424)>, <Thread(tpool_thread_0, started daemon 137533635446464)>, <Thread(tpool_thread_1, started daemon 137533627053760)>, <Thread(tpool_thread_2, started daemon 137533618661056)>, <Thread(tpool_thread_3, started daemon 137533610251968)>, <Thread(tpool_thread_4, started daemon 137533601842880)>, <Thread(tpool_thread_5, started daemon 137533593433792)>, <Thread(tpool_thread_6, started daemon 137533585024704)>, <Thread(tpool_thread_7, started daemon 137533576615616)>, <Thread(tpool_thread_8, started daemon 137533568206528)>, <Thread(tpool_thread_9, started daemon 137533559797440)>, <Thread(tpool_thread_10, started daemon 137533551388352)>, <Thread(tpool_thread_11, started daemon 137533542979264)>, <Thread(tpool_thread_12, started daemon 137533534570176)>, <Thread(tpool_thread_13, started daemon 137533526161088)>, <Thread(tpool_thread_14, started daemon 137533517752000)>, <Thread(tpool_thread_15, started daemon 137533509342912)>, <Thread(tpool_thread_16, started daemon 137533500933824)>, <Thread(tpool_thread_17, started daemon 137533492524736)>, <Thread(tpool_thread_18, started daemon 137533484115648)>, <Thread(tpool_thread_19, started daemon 137533475706560)>] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 07 18:11:02 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:11:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Flow 'volume_create_manager' (2e940a8c-46b3-45c5-85e2-9f4301151094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:11:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ec190f-3079-4306-92f8-e4ffccb72410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ec190f-3079-4306-92f8-e4ffccb72410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f8d5ac-8ab0-4610-ba90-750c32c03133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98cd2f8c25704f68983aacbd8f8f4e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:11:02Z,use_quota=True,user_id='6c7e9c8d1f3e4d8a84e066056f1ddf6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc47ea86-f304-4ba2-bafe-925a429eecfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc47ea86-f304-4ba2-bafe-925a429eecfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed97ae4a-a13c-4d7d-a462-74c2f0811fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:02 devstack cinder-volume[87269]: DEBUG cinder.image.glance [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Creating Keystone auth plugin from conf {{(pid=87269) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed97ae4a-a13c-4d7d-a462-74c2f0811fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e3f8d5ac-8ab0-4610-ba90-750c32c03133', 'volume_name': 'volume-e3f8d5ac-8ab0-4610-ba90-750c32c03133', 'volume_size': 1, 'image_id': '9347ddb8-f082-47da-b211-84253395cfdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9347ddb8-f082-47da-b211-84253395cfdd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4a9bb3c851ddb37af1fc0ad81ce45d97', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '98cd2f8c25704f68983aacbd8f8f4e96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd276c9377363227c1c18d993aab996040a0a00870d7d208e17a3fcd55f5492d1757abc4c68349392031a97989f2533a7f98e4092b1f776d3abb4863d8e6359b9', 'id': '9347ddb8-f082-47da-b211-84253395cfdd', 'created_at': datetime.datetime(2026, 9, 7, 16, 10, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 16, 11, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9347ddb8-f082-47da-b211-84253395cfdd/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d160b8e2570>}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb204955-4f22-4532-9fa5-b0f53e93d52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb204955-4f22-4532-9fa5-b0f53e93d52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a2f699-66ee-487c-b659-77880fce4f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:03 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Volume e3f8d5ac-8ab0-4610-ba90-750c32c03133: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e3f8d5ac-8ab0-4610-ba90-750c32c03133', 'volume_size': 1, 'image_id': '9347ddb8-f082-47da-b211-84253395cfdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9347ddb8-f082-47da-b211-84253395cfdd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4a9bb3c851ddb37af1fc0ad81ce45d97', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '98cd2f8c25704f68983aacbd8f8f4e96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd276c9377363227c1c18d993aab996040a0a00870d7d208e17a3fcd55f5492d1757abc4c68349392031a97989f2533a7f98e4092b1f776d3abb4863d8e6359b9', 'id': '9347ddb8-f082-47da-b211-84253395cfdd', 'created_at': datetime.datetime(2026, 9, 7, 16, 10, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 16, 11, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9347ddb8-f082-47da-b211-84253395cfdd/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d160b8e2570>}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Trying to clone e3f8d5ac-8ab0-4610-ba90-750c32c03133 from image 9347ddb8-f082-47da-b211-84253395cfdd at location (None, [{'url': 'file:///opt/stack/data/glance/images/9347ddb8-f082-47da-b211-84253395cfdd', 'metadata': {}}]). {{(pid=87269) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9347ddb8-f082-47da-b211-84253395cfdd_liqj9ptjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 07 18:11:03 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Image download 0.00 MB at 0.00 MB/s
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Flow 'volume_create_manager' (252c12c7-1251-4bb5-bec4-001a87a9b7eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ca13d2-6834-413d-8298-f8311d38a080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ab745f-c376-4d20-99fb-1b50ca2b3609]: (4, 'raw') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9347ddb8-f082-47da-b211-84253395cfdd_liqj9ptjdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ca13d2-6834-413d-8298-f8311d38a080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1656810315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c57842c-7d39-4d88-81c5-728a20a4d84c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2275b805e0b744a6895b8bdb50552d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:11:03Z,use_quota=True,user_id='73982804813d42b3bc5fdbfe31f0c569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7cae0a-c518-4f36-b85f-8bde7bee9f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7cae0a-c518-4f36-b85f-8bde7bee9f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (924aff77-f9f1-4953-a41b-928257e71995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (924aff77-f9f1-4953-a41b-928257e71995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c57842c-7d39-4d88-81c5-728a20a4d84c', 'volume_name': 'volume-9c57842c-7d39-4d88-81c5-728a20a4d84c', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6584157-37ae-4048-a1e6-01248650b5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6584157-37ae-4048-a1e6-01248650b5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5efc3ce-6c8f-4dff-a239-735a9ae5317b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:03 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Volume 9c57842c-7d39-4d88-81c5-728a20a4d84c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c57842c-7d39-4d88-81c5-728a20a4d84c', 'volume_size': 1}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1656810315',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c57842c-7d39-4d88-81c5-728a20a4d84c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2275b805e0b744a6895b8bdb50552d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:11:03Z,use_quota=True,user_id='73982804813d42b3bc5fdbfe31f0c569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Creating volume 9c57842c-7d39-4d88-81c5-728a20a4d84c {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:11:03 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9c57842c-7d39-4d88-81c5-728a20a4d84c 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:03 devstack sudo[99332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9c57842c-7d39-4d88-81c5-728a20a4d84c 1073741824
Sep 07 18:11:03 devstack sudo[99331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9347ddb8-f082-47da-b211-84253395cfdd_liqj9ptjdevstack@QuobyteHD
Sep 07 18:11:03 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:03 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:03 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9347ddb8-f082-47da-b211-84253395cfdd_liqj9ptjdevstack@QuobyteHD" returned: 0 in 0.472s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9347ddb8-f082-47da-b211-84253395cfdd_liqj9ptjdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:03 devstack sudo[99340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9347ddb8-f082-47da-b211-84253395cfdd_liqj9ptjdevstack@QuobyteHD
Sep 07 18:11:03 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:04 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9c57842c-7d39-4d88-81c5-728a20a4d84c 1073741824" returned: 0 in 0.558s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9c57842c-7d39-4d88-81c5-728a20a4d84c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:04 devstack sudo[99343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9c57842c-7d39-4d88-81c5-728a20a4d84c
Sep 07 18:11:04 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:04 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9347ddb8-f082-47da-b211-84253395cfdd_liqj9ptjdevstack@QuobyteHD" returned: 1 in 0.421s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9347ddb8-f082-47da-b211-84253395cfdd_liqj9ptjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 07 18:11:04 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Temporary image 9347ddb8-f082-47da-b211-84253395cfdd is fetched for user 6c7e9c8d1f3e4d8a84e066056f1ddf6b. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 07 18:11:04 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f43865-41ed-4202-8cca-44679f444d4e]: (4, 'raw') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:11:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9347ddb8-f082-47da-b211-84253395cfdd_liqj9ptjdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:04 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9c57842c-7d39-4d88-81c5-728a20a4d84c" returned: 0 in 0.392s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:11:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:04 devstack sudo[99348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9347ddb8-f082-47da-b211-84253395cfdd_liqj9ptjdevstack@QuobyteHD
Sep 07 18:11:04 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5efc3ce-6c8f-4dff-a239-735a9ae5317b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c57842c-7d39-4d88-81c5-728a20a4d84c', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78780f49-3cd7-49e3-a371-18f05807c19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:04 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Volume volume-9c57842c-7d39-4d88-81c5-728a20a4d84c (9c57842c-7d39-4d88-81c5-728a20a4d84c): created successfully
Sep 07 18:11:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78780f49-3cd7-49e3-a371-18f05807c19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Flow 'volume_create_manager' (252c12c7-1251-4bb5-bec4-001a87a9b7eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:11:04 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-1dd78dd6-0577-4a51-9280-dfbd47e8c13f tempest-VolumesListTestJSON-1108589817 None] Created volume successfully.
Sep 07 18:11:04 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9347ddb8-f082-47da-b211-84253395cfdd_liqj9ptjdevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9347ddb8-f082-47da-b211-84253395cfdd_liqj9ptjdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:04 devstack sudo[99353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9347ddb8-f082-47da-b211-84253395cfdd_liqj9ptjdevstack@QuobyteHD
Sep 07 18:11:04 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:05 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9347ddb8-f082-47da-b211-84253395cfdd_liqj9ptjdevstack@QuobyteHD" returned: 1 in 0.365s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9347ddb8-f082-47da-b211-84253395cfdd_liqj9ptjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 07 18:11:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3f8d5ac-8ab0-4610-ba90-750c32c03133,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98cd2f8c25704f68983aacbd8f8f4e96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:11:02Z,use_quota=True,user_id='6c7e9c8d1f3e4d8a84e066056f1ddf6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:11:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Creating volume e3f8d5ac-8ab0-4610-ba90-750c32c03133 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:11:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:11:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:11:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:11:05 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:11:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e3f8d5ac-8ab0-4610-ba90-750c32c03133 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:05 devstack sudo[99358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e3f8d5ac-8ab0-4610-ba90-750c32c03133 1073741824
Sep 07 18:11:05 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:05 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e3f8d5ac-8ab0-4610-ba90-750c32c03133 1073741824" returned: 0 in 0.739s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e3f8d5ac-8ab0-4610-ba90-750c32c03133 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:06 devstack sudo[99400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e3f8d5ac-8ab0-4610-ba90-750c32c03133
Sep 07 18:11:06 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:11:06 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Flow 'volume_create_manager' (a11ac2c8-17c9-462a-aa02-41fe4856513b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01dcafe7-852a-44d8-bf71-4d6502408231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e3f8d5ac-8ab0-4610-ba90-750c32c03133" returned: 0 in 0.485s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01dcafe7-852a-44d8-bf71-4d6502408231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-502646714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=489dc710-8807-40a0-96af-5e6d8f895e16,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2275b805e0b744a6895b8bdb50552d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:11:06Z,use_quota=True,user_id='73982804813d42b3bc5fdbfe31f0c569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7111865f-c0f4-463a-8cd8-c8a35529d713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7111865f-c0f4-463a-8cd8-c8a35529d713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b2ee42-ed64-4584-8647-cda841459aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b2ee42-ed64-4584-8647-cda841459aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '489dc710-8807-40a0-96af-5e6d8f895e16', 'volume_name': 'volume-489dc710-8807-40a0-96af-5e6d8f895e16', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ba66b1-c1c5-4149-9e46-9063c987aba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ba66b1-c1c5-4149-9e46-9063c987aba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9795253-4d3f-4cd8-b790-f5885162deb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:06 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Volume 489dc710-8807-40a0-96af-5e6d8f895e16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-489dc710-8807-40a0-96af-5e6d8f895e16', 'volume_size': 1}
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-502646714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=489dc710-8807-40a0-96af-5e6d8f895e16,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2275b805e0b744a6895b8bdb50552d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:11:06Z,use_quota=True,user_id='73982804813d42b3bc5fdbfe31f0c569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Creating volume 489dc710-8807-40a0-96af-5e6d8f895e16 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:11:06 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-489dc710-8807-40a0-96af-5e6d8f895e16 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:06 devstack sudo[99404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-489dc710-8807-40a0-96af-5e6d8f895e16 1073741824
Sep 07 18:11:06 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Attempting download of 9347ddb8-f082-47da-b211-84253395cfdd ((None, [{'url': 'file:///opt/stack/data/glance/images/9347ddb8-f082-47da-b211-84253395cfdd', 'metadata': {}}])) to volume e3f8d5ac-8ab0-4610-ba90-750c32c03133. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dddc9a4-5482-4f59-937e-deeced5250d4]: (4, 'raw') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:11:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9347ddb8-f082-47da-b211-84253395cfdd_hknrymhz {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:06 devstack sudo[99406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9347ddb8-f082-47da-b211-84253395cfdd_hknrymhz
Sep 07 18:11:06 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:07 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9347ddb8-f082-47da-b211-84253395cfdd_hknrymhz" returned: 0 in 0.388s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9347ddb8-f082-47da-b211-84253395cfdd_hknrymhz {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:07 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-489dc710-8807-40a0-96af-5e6d8f895e16 1073741824" returned: 0 in 0.541s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-489dc710-8807-40a0-96af-5e6d8f895e16 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:07 devstack sudo[99415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-489dc710-8807-40a0-96af-5e6d8f895e16
Sep 07 18:11:07 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:07 devstack sudo[99414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9347ddb8-f082-47da-b211-84253395cfdd_hknrymhz
Sep 07 18:11:07 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:07 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9347ddb8-f082-47da-b211-84253395cfdd_hknrymhz" returned: 1 in 0.399s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9347ddb8-f082-47da-b211-84253395cfdd_hknrymhz' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 07 18:11:07 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42597a0-bae1-4ee1-b6de-a27115fc1e5d]: (4, 'raw') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:11:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9347ddb8-f082-47da-b211-84253395cfdd_liqj9ptjdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:07 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-489dc710-8807-40a0-96af-5e6d8f895e16" returned: 0 in 0.381s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:11:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9795253-4d3f-4cd8-b790-f5885162deb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-489dc710-8807-40a0-96af-5e6d8f895e16', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1286e593-d4c9-4cb7-bf26-8ff4f3a2a296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:07 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Volume volume-489dc710-8807-40a0-96af-5e6d8f895e16 (489dc710-8807-40a0-96af-5e6d8f895e16): created successfully
Sep 07 18:11:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1286e593-d4c9-4cb7-bf26-8ff4f3a2a296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Flow 'volume_create_manager' (a11ac2c8-17c9-462a-aa02-41fe4856513b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:11:07 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d769ad69-8a5d-4fa8-a0db-9581ea21e26c tempest-VolumesListTestJSON-1108589817 None] Created volume successfully.
Sep 07 18:11:07 devstack sudo[99421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9347ddb8-f082-47da-b211-84253395cfdd_liqj9ptjdevstack@QuobyteHD
Sep 07 18:11:07 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:08 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9347ddb8-f082-47da-b211-84253395cfdd_liqj9ptjdevstack@QuobyteHD" returned: 0 in 0.592s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9347ddb8-f082-47da-b211-84253395cfdd_liqj9ptjdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:08 devstack sudo[99425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9347ddb8-f082-47da-b211-84253395cfdd_liqj9ptjdevstack@QuobyteHD
Sep 07 18:11:08 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:08 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9347ddb8-f082-47da-b211-84253395cfdd_liqj9ptjdevstack@QuobyteHD" returned: 1 in 0.437s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9347ddb8-f082-47da-b211-84253395cfdd_liqj9ptjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 07 18:11:08 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] 9347ddb8-f082-47da-b211-84253395cfdd was raw, converting to qcow2 {{(pid=87269) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 07 18:11:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9347ddb8-f082-47da-b211-84253395cfdd_liqj9ptjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e3f8d5ac-8ab0-4610-ba90-750c32c03133 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:08 devstack sudo[99432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9347ddb8-f082-47da-b211-84253395cfdd_liqj9ptjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e3f8d5ac-8ab0-4610-ba90-750c32c03133
Sep 07 18:11:08 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Flow 'volume_create_manager' (a37cff66-52aa-452d-a4f7-19f7ba1e7155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f65cd6d-71ab-4a8f-90d8-9393ad4fe8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f65cd6d-71ab-4a8f-90d8-9393ad4fe8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2025236898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732df69e-d48d-481b-b2b7-58544b95f0f3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2275b805e0b744a6895b8bdb50552d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:11:09Z,use_quota=True,user_id='73982804813d42b3bc5fdbfe31f0c569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf53ba14-126a-4e23-bdc5-32693f9a1863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf53ba14-126a-4e23-bdc5-32693f9a1863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b53a9b-5cd1-4687-8de3-69d5d74f7952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b53a9b-5cd1-4687-8de3-69d5d74f7952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '732df69e-d48d-481b-b2b7-58544b95f0f3', 'volume_name': 'volume-732df69e-d48d-481b-b2b7-58544b95f0f3', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0edbef7-2a38-4456-b0a3-59d4f8df53dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0edbef7-2a38-4456-b0a3-59d4f8df53dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b312ce-28c9-4729-a1d1-4753aff0dabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:09 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Volume 732df69e-d48d-481b-b2b7-58544b95f0f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-732df69e-d48d-481b-b2b7-58544b95f0f3', 'volume_size': 1}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2025236898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=732df69e-d48d-481b-b2b7-58544b95f0f3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2275b805e0b744a6895b8bdb50552d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:11:09Z,use_quota=True,user_id='73982804813d42b3bc5fdbfe31f0c569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Creating volume 732df69e-d48d-481b-b2b7-58544b95f0f3 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:11:09 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-732df69e-d48d-481b-b2b7-58544b95f0f3 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:09 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9347ddb8-f082-47da-b211-84253395cfdd_liqj9ptjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e3f8d5ac-8ab0-4610-ba90-750c32c03133" returned: 0 in 0.672s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9347ddb8-f082-47da-b211-84253395cfdd_liqj9ptjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e3f8d5ac-8ab0-4610-ba90-750c32c03133 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 07 18:11:09 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Converted 0.00 MB image at 0.00 MB/s
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e3f8d5ac-8ab0-4610-ba90-750c32c03133 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:09 devstack sudo[99463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-732df69e-d48d-481b-b2b7-58544b95f0f3 1073741824
Sep 07 18:11:09 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:09 devstack sudo[99464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e3f8d5ac-8ab0-4610-ba90-750c32c03133 1G
Sep 07 18:11:09 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:09 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e3f8d5ac-8ab0-4610-ba90-750c32c03133 1G" returned: 0 in 0.337s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Downloaded image 9347ddb8-f082-47da-b211-84253395cfdd ((None, [{'url': 'file:///opt/stack/data/glance/images/9347ddb8-f082-47da-b211-84253395cfdd', 'metadata': {}}])) to volume e3f8d5ac-8ab0-4610-ba90-750c32c03133 successfully. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Temporary image 9347ddb8-f082-47da-b211-84253395cfdd for user 6c7e9c8d1f3e4d8a84e066056f1ddf6b is deleted. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Marking volume e3f8d5ac-8ab0-4610-ba90-750c32c03133 as bootable. {{(pid=87269) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Copying metadata from image 9347ddb8-f082-47da-b211-84253395cfdd to e3f8d5ac-8ab0-4610-ba90-750c32c03133. {{(pid=87269) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Creating volume glance metadata for volume e3f8d5ac-8ab0-4610-ba90-750c32c03133 backed by image 9347ddb8-f082-47da-b211-84253395cfdd with: {'image_id': '9347ddb8-f082-47da-b211-84253395cfdd', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4a9bb3c851ddb37af1fc0ad81ce45d97', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87269) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45a2f699-66ee-487c-b659-77880fce4f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3f8d5ac-8ab0-4610-ba90-750c32c03133', 'volume_size': 1, 'image_id': '9347ddb8-f082-47da-b211-84253395cfdd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9347ddb8-f082-47da-b211-84253395cfdd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4a9bb3c851ddb37af1fc0ad81ce45d97', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '98cd2f8c25704f68983aacbd8f8f4e96', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd276c9377363227c1c18d993aab996040a0a00870d7d208e17a3fcd55f5492d1757abc4c68349392031a97989f2533a7f98e4092b1f776d3abb4863d8e6359b9', 'id': '9347ddb8-f082-47da-b211-84253395cfdd', 'created_at': datetime.datetime(2026, 9, 7, 16, 10, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 16, 11, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9347ddb8-f082-47da-b211-84253395cfdd/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d160b8e2570>}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84b8d270-19b2-4d26-bbf5-85468389375a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:09 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Volume volume-e3f8d5ac-8ab0-4610-ba90-750c32c03133 (e3f8d5ac-8ab0-4610-ba90-750c32c03133): created successfully
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84b8d270-19b2-4d26-bbf5-85468389375a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Flow 'volume_create_manager' (2e940a8c-46b3-45c5-85e2-9f4301151094) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:11:09 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-02b8f445-d348-4f90-9c13-e57345b860c6 tempest-VolumeImageDependencyTests-695785612 None] Created volume successfully.
Sep 07 18:11:09 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-732df69e-d48d-481b-b2b7-58544b95f0f3 1073741824" returned: 0 in 0.524s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-732df69e-d48d-481b-b2b7-58544b95f0f3 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:09 devstack sudo[99475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-732df69e-d48d-481b-b2b7-58544b95f0f3
Sep 07 18:11:09 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:10 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-732df69e-d48d-481b-b2b7-58544b95f0f3" returned: 0 in 0.287s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:11:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b312ce-28c9-4729-a1d1-4753aff0dabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-732df69e-d48d-481b-b2b7-58544b95f0f3', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45339e09-21c9-4adc-9281-8f019a389ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:10 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Volume volume-732df69e-d48d-481b-b2b7-58544b95f0f3 (732df69e-d48d-481b-b2b7-58544b95f0f3): created successfully
Sep 07 18:11:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45339e09-21c9-4adc-9281-8f019a389ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Flow 'volume_create_manager' (a37cff66-52aa-452d-a4f7-19f7ba1e7155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:11:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7d3dbf9a-829f-435c-80cc-503bbbc7aa25 tempest-VolumeImageDependencyTests-695785612 None] Acquiring lock "cinder-e3f8d5ac-8ab0-4610-ba90-750c32c03133-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:10 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-7dd5af28-ed27-412f-ad9a-83848c68fba1 tempest-VolumesListTestJSON-1108589817 None] Created volume successfully.
Sep 07 18:11:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7d3dbf9a-829f-435c-80cc-503bbbc7aa25 tempest-VolumeImageDependencyTests-695785612 None] Lock "cinder-e3f8d5ac-8ab0-4610-ba90-750c32c03133-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7d3dbf9a-829f-435c-80cc-503bbbc7aa25 tempest-VolumeImageDependencyTests-695785612 None] Acquiring lock "cinder-quobyte-e3f8d5ac-8ab0-4610-ba90-750c32c03133" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7d3dbf9a-829f-435c-80cc-503bbbc7aa25 tempest-VolumeImageDependencyTests-695785612 None] Lock "cinder-quobyte-e3f8d5ac-8ab0-4610-ba90-750c32c03133" acquired by "delete_volume" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:10 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f48149-b05d-4815-86f7-7fbd3b3e837b]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:11:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d3dbf9a-829f-435c-80cc-503bbbc7aa25 tempest-VolumeImageDependencyTests-695785612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e3f8d5ac-8ab0-4610-ba90-750c32c03133 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:10 devstack sudo[99479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e3f8d5ac-8ab0-4610-ba90-750c32c03133
Sep 07 18:11:10 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:10 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d3dbf9a-829f-435c-80cc-503bbbc7aa25 tempest-VolumeImageDependencyTests-695785612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e3f8d5ac-8ab0-4610-ba90-750c32c03133" returned: 0 in 0.382s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d3dbf9a-829f-435c-80cc-503bbbc7aa25 tempest-VolumeImageDependencyTests-695785612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e3f8d5ac-8ab0-4610-ba90-750c32c03133 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:10 devstack sudo[99485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e3f8d5ac-8ab0-4610-ba90-750c32c03133
Sep 07 18:11:10 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:10 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d3dbf9a-829f-435c-80cc-503bbbc7aa25 tempest-VolumeImageDependencyTests-695785612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e3f8d5ac-8ab0-4610-ba90-750c32c03133" returned: 0 in 0.268s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7d3dbf9a-829f-435c-80cc-503bbbc7aa25 tempest-VolumeImageDependencyTests-695785612 None] Lock "cinder-quobyte-e3f8d5ac-8ab0-4610-ba90-750c32c03133" released by "delete_volume" :: held 0.693s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:10 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-7d3dbf9a-829f-435c-80cc-503bbbc7aa25 tempest-VolumeImageDependencyTests-695785612 None] Created reservations ['4a4a5dda-ced6-490d-9ab2-76cdee88d403', 'c6ddd5a9-a31a-400a-8d0d-d024920585f6', '175df9fa-c446-4420-a336-8c4db2d27236', 'd10e1736-0629-49ea-95f5-e554cb77fa32'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:11:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7d3dbf9a-829f-435c-80cc-503bbbc7aa25 tempest-VolumeImageDependencyTests-695785612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7d3dbf9a-829f-435c-80cc-503bbbc7aa25 tempest-VolumeImageDependencyTests-695785612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7d3dbf9a-829f-435c-80cc-503bbbc7aa25 tempest-VolumeImageDependencyTests-695785612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:11:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7d3dbf9a-829f-435c-80cc-503bbbc7aa25 tempest-VolumeImageDependencyTests-695785612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:11:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7d3dbf9a-829f-435c-80cc-503bbbc7aa25 tempest-VolumeImageDependencyTests-695785612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d3dbf9a-829f-435c-80cc-503bbbc7aa25 tempest-VolumeImageDependencyTests-695785612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:11 devstack sudo[99488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:11:11 devstack sudo[99488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:11 devstack sudo[99488]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7d3dbf9a-829f-435c-80cc-503bbbc7aa25 tempest-VolumeImageDependencyTests-695785612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.283s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:11 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-7d3dbf9a-829f-435c-80cc-503bbbc7aa25 tempest-VolumeImageDependencyTests-695785612 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:11:11 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-7d3dbf9a-829f-435c-80cc-503bbbc7aa25 tempest-VolumeImageDependencyTests-695785612 None] Deleted volume successfully.
Sep 07 18:11:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7d3dbf9a-829f-435c-80cc-503bbbc7aa25 tempest-VolumeImageDependencyTests-695785612 None] Lock "cinder-e3f8d5ac-8ab0-4610-ba90-750c32c03133-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-eebe5eb6-77ad-4002-9ae1-0bad64f8da26 tempest-VolumesListTestJSON-1108589817 None] Acquiring lock "cinder-732df69e-d48d-481b-b2b7-58544b95f0f3-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-eebe5eb6-77ad-4002-9ae1-0bad64f8da26 tempest-VolumesListTestJSON-1108589817 None] Lock "cinder-732df69e-d48d-481b-b2b7-58544b95f0f3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-eebe5eb6-77ad-4002-9ae1-0bad64f8da26 tempest-VolumesListTestJSON-1108589817 None] Acquiring lock "cinder-quobyte-732df69e-d48d-481b-b2b7-58544b95f0f3" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-eebe5eb6-77ad-4002-9ae1-0bad64f8da26 tempest-VolumesListTestJSON-1108589817 None] Lock "cinder-quobyte-732df69e-d48d-481b-b2b7-58544b95f0f3" acquired by "delete_volume" :: waited 0.027s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:14 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ff117d-02a4-4141-b080-7d56c2a9db9d]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:11:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-eebe5eb6-77ad-4002-9ae1-0bad64f8da26 tempest-VolumesListTestJSON-1108589817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-732df69e-d48d-481b-b2b7-58544b95f0f3 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:14 devstack sudo[99491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-732df69e-d48d-481b-b2b7-58544b95f0f3
Sep 07 18:11:14 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:14 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-eebe5eb6-77ad-4002-9ae1-0bad64f8da26 tempest-VolumesListTestJSON-1108589817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-732df69e-d48d-481b-b2b7-58544b95f0f3" returned: 0 in 0.400s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-eebe5eb6-77ad-4002-9ae1-0bad64f8da26 tempest-VolumesListTestJSON-1108589817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-732df69e-d48d-481b-b2b7-58544b95f0f3 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:14 devstack sudo[99496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-732df69e-d48d-481b-b2b7-58544b95f0f3
Sep 07 18:11:14 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:14 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-eebe5eb6-77ad-4002-9ae1-0bad64f8da26 tempest-VolumesListTestJSON-1108589817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-732df69e-d48d-481b-b2b7-58544b95f0f3" returned: 0 in 0.347s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-eebe5eb6-77ad-4002-9ae1-0bad64f8da26 tempest-VolumesListTestJSON-1108589817 None] Lock "cinder-quobyte-732df69e-d48d-481b-b2b7-58544b95f0f3" released by "delete_volume" :: held 0.800s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Flow 'volume_create_manager' (b2a09659-0e62-4e44-bf88-51990e5b1abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fece208-8e2f-4501-b473-5387c69a324a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fece208-8e2f-4501-b473-5387c69a324a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee74f9f4-052e-40b0-807a-c4268b222187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee77883e18b442b923b077dc31b595e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:11:15Z,use_quota=True,user_id='9d718783ee114882b7b44374259e25ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (466cc47d-854b-4293-bef8-f0fb1acaa299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (466cc47d-854b-4293-bef8-f0fb1acaa299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ca8bd2-0ce2-4c3d-8b5e-86765145627e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42ca8bd2-0ce2-4c3d-8b5e-86765145627e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee74f9f4-052e-40b0-807a-c4268b222187', 'volume_name': 'volume-ee74f9f4-052e-40b0-807a-c4268b222187', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe00610c-38ca-4f3c-9703-90894da72cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe00610c-38ca-4f3c-9703-90894da72cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510f6db0-c169-41ed-85fc-eb9d5361fdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:15 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Volume ee74f9f4-052e-40b0-807a-c4268b222187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee74f9f4-052e-40b0-807a-c4268b222187', 'volume_size': 1}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:11:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee74f9f4-052e-40b0-807a-c4268b222187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee77883e18b442b923b077dc31b595e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:11:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:11:15Z,use_quota=True,user_id='9d718783ee114882b7b44374259e25ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Creating volume ee74f9f4-052e-40b0-807a-c4268b222187 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:11:15 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ee74f9f4-052e-40b0-807a-c4268b222187 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:15 devstack sudo[99499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ee74f9f4-052e-40b0-807a-c4268b222187 1073741824
Sep 07 18:11:15 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-eebe5eb6-77ad-4002-9ae1-0bad64f8da26 tempest-VolumesListTestJSON-1108589817 None] Created reservations ['93932b4c-2a11-478f-b73c-df4a11434ba6', '63aebac0-8c6c-4055-ac68-c822d5f6e222', 'b0845333-05ea-42d5-94d6-2d3f8e53f865', 'd87e6590-0418-4d68-a47f-2b6a0a8f77bc'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-eebe5eb6-77ad-4002-9ae1-0bad64f8da26 tempest-VolumesListTestJSON-1108589817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-eebe5eb6-77ad-4002-9ae1-0bad64f8da26 tempest-VolumesListTestJSON-1108589817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-eebe5eb6-77ad-4002-9ae1-0bad64f8da26 tempest-VolumesListTestJSON-1108589817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-eebe5eb6-77ad-4002-9ae1-0bad64f8da26 tempest-VolumesListTestJSON-1108589817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-eebe5eb6-77ad-4002-9ae1-0bad64f8da26 tempest-VolumesListTestJSON-1108589817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-eebe5eb6-77ad-4002-9ae1-0bad64f8da26 tempest-VolumesListTestJSON-1108589817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:15 devstack sudo[99501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:11:15 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ed563d3f-7eb3-4c70-8ddb-3813631af391 tempest-VolumesListTestJSON-1108589817 None] Acquiring lock "cinder-489dc710-8807-40a0-96af-5e6d8f895e16-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ed563d3f-7eb3-4c70-8ddb-3813631af391 tempest-VolumesListTestJSON-1108589817 None] Lock "cinder-489dc710-8807-40a0-96af-5e6d8f895e16-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ed563d3f-7eb3-4c70-8ddb-3813631af391 tempest-VolumesListTestJSON-1108589817 None] Acquiring lock "cinder-quobyte-489dc710-8807-40a0-96af-5e6d8f895e16" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ed563d3f-7eb3-4c70-8ddb-3813631af391 tempest-VolumesListTestJSON-1108589817 None] Lock "cinder-quobyte-489dc710-8807-40a0-96af-5e6d8f895e16" acquired by "delete_volume" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3807eaac-6b03-4155-9217-71a05b13ceb0]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ed563d3f-7eb3-4c70-8ddb-3813631af391 tempest-VolumesListTestJSON-1108589817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-489dc710-8807-40a0-96af-5e6d8f895e16 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:15 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-eebe5eb6-77ad-4002-9ae1-0bad64f8da26 tempest-VolumesListTestJSON-1108589817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.370s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-eebe5eb6-77ad-4002-9ae1-0bad64f8da26 tempest-VolumesListTestJSON-1108589817 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:11:15 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-eebe5eb6-77ad-4002-9ae1-0bad64f8da26 tempest-VolumesListTestJSON-1108589817 None] Deleted volume successfully.
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-eebe5eb6-77ad-4002-9ae1-0bad64f8da26 tempest-VolumesListTestJSON-1108589817 None] Lock "cinder-732df69e-d48d-481b-b2b7-58544b95f0f3-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:15 devstack sudo[99508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-489dc710-8807-40a0-96af-5e6d8f895e16
Sep 07 18:11:15 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:15 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ee74f9f4-052e-40b0-807a-c4268b222187 1073741824" returned: 0 in 0.632s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ee74f9f4-052e-40b0-807a-c4268b222187 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:15 devstack sudo[99510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ee74f9f4-052e-40b0-807a-c4268b222187
Sep 07 18:11:15 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:15 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ed563d3f-7eb3-4c70-8ddb-3813631af391 tempest-VolumesListTestJSON-1108589817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-489dc710-8807-40a0-96af-5e6d8f895e16" returned: 0 in 0.421s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ed563d3f-7eb3-4c70-8ddb-3813631af391 tempest-VolumesListTestJSON-1108589817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-489dc710-8807-40a0-96af-5e6d8f895e16 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:16 devstack sudo[99515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-489dc710-8807-40a0-96af-5e6d8f895e16
Sep 07 18:11:16 devstack sudo[99515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:16 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ee74f9f4-052e-40b0-807a-c4268b222187" returned: 0 in 0.271s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:11:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510f6db0-c169-41ed-85fc-eb9d5361fdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee74f9f4-052e-40b0-807a-c4268b222187', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335f3376-74c9-4094-9984-63f1989aca35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:16 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Volume volume-ee74f9f4-052e-40b0-807a-c4268b222187 (ee74f9f4-052e-40b0-807a-c4268b222187): created successfully
Sep 07 18:11:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335f3376-74c9-4094-9984-63f1989aca35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Flow 'volume_create_manager' (b2a09659-0e62-4e44-bf88-51990e5b1abb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:11:16 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-29a79789-36c9-4f2f-8649-5cb61f9cb216 tempest-CinderUnicodeTest-71289627 None] Created volume successfully.
Sep 07 18:11:16 devstack sudo[99515]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ed563d3f-7eb3-4c70-8ddb-3813631af391 tempest-VolumesListTestJSON-1108589817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-489dc710-8807-40a0-96af-5e6d8f895e16" returned: 0 in 0.291s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ed563d3f-7eb3-4c70-8ddb-3813631af391 tempest-VolumesListTestJSON-1108589817 None] Lock "cinder-quobyte-489dc710-8807-40a0-96af-5e6d8f895e16" released by "delete_volume" :: held 0.763s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:16 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-ed563d3f-7eb3-4c70-8ddb-3813631af391 tempest-VolumesListTestJSON-1108589817 None] Created reservations ['63710cb5-dbbf-4b71-b44a-4a29606b9ac4', '16dda8be-8ef1-4699-b5cd-084433ab48c1', '842e43db-88ee-46c6-8bb6-45f583025422', '80c6f844-dfa5-4c09-b3cb-288e0bd7d535'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:11:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ed563d3f-7eb3-4c70-8ddb-3813631af391 tempest-VolumesListTestJSON-1108589817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ed563d3f-7eb3-4c70-8ddb-3813631af391 tempest-VolumesListTestJSON-1108589817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ed563d3f-7eb3-4c70-8ddb-3813631af391 tempest-VolumesListTestJSON-1108589817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:11:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ed563d3f-7eb3-4c70-8ddb-3813631af391 tempest-VolumesListTestJSON-1108589817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:11:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ed563d3f-7eb3-4c70-8ddb-3813631af391 tempest-VolumesListTestJSON-1108589817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ed563d3f-7eb3-4c70-8ddb-3813631af391 tempest-VolumesListTestJSON-1108589817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:16 devstack sudo[99520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:11:16 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:16 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ed563d3f-7eb3-4c70-8ddb-3813631af391 tempest-VolumesListTestJSON-1108589817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.317s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:16 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-ed563d3f-7eb3-4c70-8ddb-3813631af391 tempest-VolumesListTestJSON-1108589817 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:11:16 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ed563d3f-7eb3-4c70-8ddb-3813631af391 tempest-VolumesListTestJSON-1108589817 None] Deleted volume successfully.
Sep 07 18:11:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-feebe13e-a2dd-48d2-9ae0-44df0723d28e tempest-VolumesListTestJSON-1108589817 None] Acquiring lock "cinder-9c57842c-7d39-4d88-81c5-728a20a4d84c-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ed563d3f-7eb3-4c70-8ddb-3813631af391 tempest-VolumesListTestJSON-1108589817 None] Lock "cinder-489dc710-8807-40a0-96af-5e6d8f895e16-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-feebe13e-a2dd-48d2-9ae0-44df0723d28e tempest-VolumesListTestJSON-1108589817 None] Lock "cinder-9c57842c-7d39-4d88-81c5-728a20a4d84c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-feebe13e-a2dd-48d2-9ae0-44df0723d28e tempest-VolumesListTestJSON-1108589817 None] Acquiring lock "cinder-quobyte-9c57842c-7d39-4d88-81c5-728a20a4d84c" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-feebe13e-a2dd-48d2-9ae0-44df0723d28e tempest-VolumesListTestJSON-1108589817 None] Lock "cinder-quobyte-9c57842c-7d39-4d88-81c5-728a20a4d84c" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:16 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d5c839-96cb-4b53-abfe-5ee7885b0781]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:11:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-feebe13e-a2dd-48d2-9ae0-44df0723d28e tempest-VolumesListTestJSON-1108589817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9c57842c-7d39-4d88-81c5-728a20a4d84c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:17 devstack sudo[99523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9c57842c-7d39-4d88-81c5-728a20a4d84c
Sep 07 18:11:17 devstack sudo[99523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:17 devstack sudo[99523]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-feebe13e-a2dd-48d2-9ae0-44df0723d28e tempest-VolumesListTestJSON-1108589817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9c57842c-7d39-4d88-81c5-728a20a4d84c" returned: 0 in 0.486s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-feebe13e-a2dd-48d2-9ae0-44df0723d28e tempest-VolumesListTestJSON-1108589817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9c57842c-7d39-4d88-81c5-728a20a4d84c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:17 devstack sudo[99528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9c57842c-7d39-4d88-81c5-728a20a4d84c
Sep 07 18:11:17 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:17 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-feebe13e-a2dd-48d2-9ae0-44df0723d28e tempest-VolumesListTestJSON-1108589817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9c57842c-7d39-4d88-81c5-728a20a4d84c" returned: 0 in 0.365s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-feebe13e-a2dd-48d2-9ae0-44df0723d28e tempest-VolumesListTestJSON-1108589817 None] Lock "cinder-quobyte-9c57842c-7d39-4d88-81c5-728a20a4d84c" released by "delete_volume" :: held 0.916s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:17 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-feebe13e-a2dd-48d2-9ae0-44df0723d28e tempest-VolumesListTestJSON-1108589817 None] Created reservations ['a7adf7a6-f379-4e4f-becb-62e1acb07747', '803f553b-e787-4128-b5e6-7b1623d75def', '658b9edc-1faa-4cd2-90f0-6cb1f70739af', '258836d9-6a80-4e76-a0a1-aea8a01ba109'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:11:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-feebe13e-a2dd-48d2-9ae0-44df0723d28e tempest-VolumesListTestJSON-1108589817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-feebe13e-a2dd-48d2-9ae0-44df0723d28e tempest-VolumesListTestJSON-1108589817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-feebe13e-a2dd-48d2-9ae0-44df0723d28e tempest-VolumesListTestJSON-1108589817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:11:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-feebe13e-a2dd-48d2-9ae0-44df0723d28e tempest-VolumesListTestJSON-1108589817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:11:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-feebe13e-a2dd-48d2-9ae0-44df0723d28e tempest-VolumesListTestJSON-1108589817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-feebe13e-a2dd-48d2-9ae0-44df0723d28e tempest-VolumesListTestJSON-1108589817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:18 devstack sudo[99531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:11:18 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:18 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:11:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Flow 'volume_create_manager' (f6e1ab1d-8590-4a3c-aa09-27a03196adfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:11:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed7b3ae-3b60-49c3-8db4-8ac85e25af32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed7b3ae-3b60-49c3-8db4-8ac85e25af32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:11:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1556178901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e85683a6-5d98-4403-9ff1-168569f3a459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee77883e18b442b923b077dc31b595e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:11:18Z,use_quota=True,user_id='9d718783ee114882b7b44374259e25ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca9f8f7-f3a8-4efd-bed2-cebd2bcae5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca9f8f7-f3a8-4efd-bed2-cebd2bcae5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e26d810e-24f6-4a08-90ca-2a455ef6ac13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e26d810e-24f6-4a08-90ca-2a455ef6ac13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e85683a6-5d98-4403-9ff1-168569f3a459', 'volume_name': 'volume-e85683a6-5d98-4403-9ff1-168569f3a459', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77050c7-589b-45bb-9c28-33e93f2bb100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f77050c7-589b-45bb-9c28-33e93f2bb100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7bef26-8ae3-417d-88f3-bccae1877904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:18 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Volume e85683a6-5d98-4403-9ff1-168569f3a459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e85683a6-5d98-4403-9ff1-168569f3a459', 'volume_size': 1}
Sep 07 18:11:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:11:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1556178901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e85683a6-5d98-4403-9ff1-168569f3a459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee77883e18b442b923b077dc31b595e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:11:18Z,use_quota=True,user_id='9d718783ee114882b7b44374259e25ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:11:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Creating volume e85683a6-5d98-4403-9ff1-168569f3a459 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:11:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:11:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:11:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:11:18 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:11:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:18 devstack sudo[99533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459 1073741824
Sep 07 18:11:18 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:18 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-feebe13e-a2dd-48d2-9ae0-44df0723d28e tempest-VolumesListTestJSON-1108589817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.429s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:18 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-feebe13e-a2dd-48d2-9ae0-44df0723d28e tempest-VolumesListTestJSON-1108589817 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:11:18 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-feebe13e-a2dd-48d2-9ae0-44df0723d28e tempest-VolumesListTestJSON-1108589817 None] Deleted volume successfully.
Sep 07 18:11:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-feebe13e-a2dd-48d2-9ae0-44df0723d28e tempest-VolumesListTestJSON-1108589817 None] Lock "cinder-9c57842c-7d39-4d88-81c5-728a20a4d84c-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:18 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459 1073741824" returned: 0 in 0.666s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:18 devstack sudo[99540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459
Sep 07 18:11:18 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:19 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459" returned: 0 in 0.254s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:11:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd7bef26-8ae3-417d-88f3-bccae1877904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e85683a6-5d98-4403-9ff1-168569f3a459', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6785d9-e9d9-48b7-8d69-c297a4eafebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:19 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Volume volume-e85683a6-5d98-4403-9ff1-168569f3a459 (e85683a6-5d98-4403-9ff1-168569f3a459): created successfully
Sep 07 18:11:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6785d9-e9d9-48b7-8d69-c297a4eafebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Flow 'volume_create_manager' (f6e1ab1d-8590-4a3c-aa09-27a03196adfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:11:19 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a21ddef3-7b9c-447a-bb36-f02abce53d98 tempest-CinderUnicodeTest-71289627 None] Created volume successfully.
Sep 07 18:11:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4bb6b96f-8f66-462e-a72b-a602ebc3a175 tempest-CinderUnicodeTest-71289627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4bb6b96f-8f66-462e-a72b-a602ebc3a175 tempest-CinderUnicodeTest-71289627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4bb6b96f-8f66-462e-a72b-a602ebc3a175 tempest-CinderUnicodeTest-71289627 None] Creating offline snapshot 6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f of volume e85683a6-5d98-4403-9ff1-168569f3a459 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:11:20 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13663c3-4a2b-4436-8bdf-818ea5cf8055]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:11:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4bb6b96f-8f66-462e-a72b-a602ebc3a175 tempest-CinderUnicodeTest-71289627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:20 devstack sudo[99545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459
Sep 07 18:11:20 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:20 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4bb6b96f-8f66-462e-a72b-a602ebc3a175 tempest-CinderUnicodeTest-71289627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459" returned: 0 in 0.570s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4bb6b96f-8f66-462e-a72b-a602ebc3a175 tempest-CinderUnicodeTest-71289627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459.6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:20 devstack sudo[99551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459.6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f 1G
Sep 07 18:11:20 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:21 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:11:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Flow 'volume_create_manager' (220f9845-a84d-4486-804f-2e6e60ccc8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:11:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db6131f4-64b6-4cc0-81c4-efddaa5090e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db6131f4-64b6-4cc0-81c4-efddaa5090e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-998202086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b09ae4-2582-49f3-aad8-ee0f6cf89c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c6445e4479a4f25bcce2536b55b37f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:11:21Z,use_quota=True,user_id='06f038df90f74342888199086c12f09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a9036b-4603-4fd5-b464-e2b803c3f78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a9036b-4603-4fd5-b464-e2b803c3f78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a6d0c3a-15cf-4af3-b523-01e936459813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a6d0c3a-15cf-4af3-b523-01e936459813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3b09ae4-2582-49f3-aad8-ee0f6cf89c15', 'volume_name': 'volume-f3b09ae4-2582-49f3-aad8-ee0f6cf89c15', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e7adc0e-be0f-48a8-9502-5726a4d89a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e7adc0e-be0f-48a8-9502-5726a4d89a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8242e7-7145-444b-aa33-56e4551027dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:21 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Volume f3b09ae4-2582-49f3-aad8-ee0f6cf89c15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3b09ae4-2582-49f3-aad8-ee0f6cf89c15', 'volume_size': 1}
Sep 07 18:11:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:21 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4bb6b96f-8f66-462e-a72b-a602ebc3a175 tempest-CinderUnicodeTest-71289627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459.6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f 1G" returned: 0 in 0.490s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4bb6b96f-8f66-462e-a72b-a602ebc3a175 tempest-CinderUnicodeTest-71289627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e85683a6-5d98-4403-9ff1-168569f3a459 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459.6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:21 devstack sudo[99557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e85683a6-5d98-4403-9ff1-168569f3a459 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459.6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f
Sep 07 18:11:21 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:21 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4bb6b96f-8f66-462e-a72b-a602ebc3a175 tempest-CinderUnicodeTest-71289627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e85683a6-5d98-4403-9ff1-168569f3a459 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459.6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f" returned: 0 in 0.327s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:21 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-4bb6b96f-8f66-462e-a72b-a602ebc3a175 tempest-CinderUnicodeTest-71289627 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459.6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f is being set with open permissions: ugo+rw
Sep 07 18:11:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4bb6b96f-8f66-462e-a72b-a602ebc3a175 tempest-CinderUnicodeTest-71289627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459.6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:21 devstack sudo[99567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459.6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f
Sep 07 18:11:21 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:22 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4bb6b96f-8f66-462e-a72b-a602ebc3a175 tempest-CinderUnicodeTest-71289627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459.6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f" returned: 0 in 0.412s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4bb6b96f-8f66-462e-a72b-a602ebc3a175 tempest-CinderUnicodeTest-71289627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:22 devstack sudo[99570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459.info
Sep 07 18:11:22 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:22 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4bb6b96f-8f66-462e-a72b-a602ebc3a175 tempest-CinderUnicodeTest-71289627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459.info" returned: 0 in 0.307s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:22 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-4bb6b96f-8f66-462e-a72b-a602ebc3a175 tempest-CinderUnicodeTest-71289627 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459.info is being set with open permissions: ugo+rw
Sep 07 18:11:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4bb6b96f-8f66-462e-a72b-a602ebc3a175 tempest-CinderUnicodeTest-71289627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:22 devstack sudo[99573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459.info
Sep 07 18:11:22 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:22 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4bb6b96f-8f66-462e-a72b-a602ebc3a175 tempest-CinderUnicodeTest-71289627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459.info" returned: 0 in 0.355s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4bb6b96f-8f66-462e-a72b-a602ebc3a175 tempest-CinderUnicodeTest-71289627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.595s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.787s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-998202086',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3b09ae4-2582-49f3-aad8-ee0f6cf89c15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c6445e4479a4f25bcce2536b55b37f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:11:21Z,use_quota=True,user_id='06f038df90f74342888199086c12f09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:11:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Creating volume f3b09ae4-2582-49f3-aad8-ee0f6cf89c15 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:11:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:11:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:11:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:11:22 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:11:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f3b09ae4-2582-49f3-aad8-ee0f6cf89c15 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:22 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4bb6b96f-8f66-462e-a72b-a602ebc3a175 tempest-CinderUnicodeTest-71289627 None] Create snapshot completed successfully
Sep 07 18:11:22 devstack sudo[99576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f3b09ae4-2582-49f3-aad8-ee0f6cf89c15 1073741824
Sep 07 18:11:22 devstack sudo[99576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Flow 'volume_create_manager' (796d63fb-0b4a-441f-9d57-6dd2f783e33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a432a540-1639-439b-84f5-a27462f81429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a432a540-1639-439b-84f5-a27462f81429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-76321770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37871ac-fd8a-46f6-9544-f9164d3d40d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f58ce0ed60a144a3a3c27c3f1f374c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:11:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:11:23Z,use_quota=True,user_id='ab1dc844aaaa4d15af8cf0a783627582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5fb8c19-cf5a-4fa7-8fb7-17df893267a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5fb8c19-cf5a-4fa7-8fb7-17df893267a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20486160-3550-4f1d-ade1-4e90158d10a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20486160-3550-4f1d-ade1-4e90158d10a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a37871ac-fd8a-46f6-9544-f9164d3d40d2', 'volume_name': 'volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2', 'volume_size': 2}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b36224-159d-4386-882c-6f01d9e85ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b36224-159d-4386-882c-6f01d9e85ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f639855a-de95-44e0-84b1-30f818960804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:23 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Volume a37871ac-fd8a-46f6-9544-f9164d3d40d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2', 'volume_size': 2}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:23 devstack sudo[99576]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f3b09ae4-2582-49f3-aad8-ee0f6cf89c15 1073741824" returned: 0 in 0.591s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5dce3f2b-d6db-4944-b475-cf4d036de03a tempest-CinderUnicodeTest-71289627 None] Acquiring lock "cinder-6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5dce3f2b-d6db-4944-b475-cf4d036de03a tempest-CinderUnicodeTest-71289627 None] Lock "cinder-6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5dce3f2b-d6db-4944-b475-cf4d036de03a tempest-CinderUnicodeTest-71289627 None] Acquiring lock "cinder-quobyte-e85683a6-5d98-4403-9ff1-168569f3a459" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f3b09ae4-2582-49f3-aad8-ee0f6cf89c15 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5dce3f2b-d6db-4944-b475-cf4d036de03a tempest-CinderUnicodeTest-71289627 None] Lock "cinder-quobyte-e85683a6-5d98-4403-9ff1-168569f3a459" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5dce3f2b-d6db-4944-b475-cf4d036de03a tempest-CinderUnicodeTest-71289627 None] Acquiring lock "cinder-quobyte-6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:23 devstack sudo[99588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f3b09ae4-2582-49f3-aad8-ee0f6cf89c15
Sep 07 18:11:23 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5dce3f2b-d6db-4944-b475-cf4d036de03a tempest-CinderUnicodeTest-71289627 None] Lock "cinder-quobyte-6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-5dce3f2b-d6db-4944-b475-cf4d036de03a tempest-CinderUnicodeTest-71289627 None] Deleting offline snapshot 6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f of volume e85683a6-5d98-4403-9ff1-168569f3a459 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-5dce3f2b-d6db-4944-b475-cf4d036de03a tempest-CinderUnicodeTest-71289627 None] snapshot_file for this snap is: volume-e85683a6-5d98-4403-9ff1-168569f3a459.6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1a69cd-addd-41fb-902c-5397e6bb667b]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5dce3f2b-d6db-4944-b475-cf4d036de03a tempest-CinderUnicodeTest-71289627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459.6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:23 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:23 devstack sudo[99590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459.6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f
Sep 07 18:11:23 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f3b09ae4-2582-49f3-aad8-ee0f6cf89c15" returned: 0 in 0.319s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.810s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-76321770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37871ac-fd8a-46f6-9544-f9164d3d40d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f58ce0ed60a144a3a3c27c3f1f374c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:11:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:11:23Z,use_quota=True,user_id='ab1dc844aaaa4d15af8cf0a783627582',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Creating volume a37871ac-fd8a-46f6-9544-f9164d3d40d2 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:11:23 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2 2147483648 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb8242e7-7145-444b-aa33-56e4551027dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3b09ae4-2582-49f3-aad8-ee0f6cf89c15', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f5aaf6-4f88-48dc-ad1b-68f1d5371163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:23 devstack sudo[99593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2 2147483648
Sep 07 18:11:23 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:23 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Volume volume-f3b09ae4-2582-49f3-aad8-ee0f6cf89c15 (f3b09ae4-2582-49f3-aad8-ee0f6cf89c15): created successfully
Sep 07 18:11:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f5aaf6-4f88-48dc-ad1b-68f1d5371163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Flow 'volume_create_manager' (220f9845-a84d-4486-804f-2e6e60ccc8af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:11:24 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a17fa326-6f65-4777-b208-16dc2823f2df tempest-AttachVolumeNegativeTest-1258960963 None] Created volume successfully.
Sep 07 18:11:24 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5dce3f2b-d6db-4944-b475-cf4d036de03a tempest-CinderUnicodeTest-71289627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459.6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f" returned: 0 in 0.579s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-5dce3f2b-d6db-4944-b475-cf4d036de03a tempest-CinderUnicodeTest-71289627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e85683a6-5d98-4403-9ff1-168569f3a459(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:11:24 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[16778aba-d2d9-4119-a790-b85cb8dcbff0]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:11:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5dce3f2b-d6db-4944-b475-cf4d036de03a tempest-CinderUnicodeTest-71289627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:24 devstack sudo[99602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459
Sep 07 18:11:24 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:24 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2 2147483648" returned: 0 in 0.819s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:24 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5dce3f2b-d6db-4944-b475-cf4d036de03a tempest-CinderUnicodeTest-71289627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459" returned: 0 in 0.517s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5dce3f2b-d6db-4944-b475-cf4d036de03a tempest-CinderUnicodeTest-71289627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459.6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:24 devstack sudo[99611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2
Sep 07 18:11:24 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:24 devstack sudo[99612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459.6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f
Sep 07 18:11:24 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:25 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2" returned: 0 in 0.317s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:11:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f639855a-de95-44e0-84b1-30f818960804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2', 'volume_size': 2}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4a75ee-c705-4afc-86e5-1bf4049cdc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:25 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Volume volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2 (a37871ac-fd8a-46f6-9544-f9164d3d40d2): created successfully
Sep 07 18:11:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4a75ee-c705-4afc-86e5-1bf4049cdc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Flow 'volume_create_manager' (796d63fb-0b4a-441f-9d57-6dd2f783e33c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:11:25 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-275019d0-55ae-46e2-bcd2-d36e21bb9c70 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Created volume successfully.
Sep 07 18:11:25 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5dce3f2b-d6db-4944-b475-cf4d036de03a tempest-CinderUnicodeTest-71289627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459.6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f" returned: 0 in 0.494s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5dce3f2b-d6db-4944-b475-cf4d036de03a tempest-CinderUnicodeTest-71289627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459.6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:25 devstack sudo[99624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459.6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f
Sep 07 18:11:25 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-a1c83f91-13c7-4ddd-a40e-2278f164a413 req-8f76c62f-042e-407f-9529-5900756284b9 tempest-AttachVolumeNegativeTest-1258960963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-a1c83f91-13c7-4ddd-a40e-2278f164a413 req-8f76c62f-042e-407f-9529-5900756284b9 tempest-AttachVolumeNegativeTest-1258960963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-a1c83f91-13c7-4ddd-a40e-2278f164a413 req-8f76c62f-042e-407f-9529-5900756284b9 tempest-AttachVolumeNegativeTest-1258960963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-a1c83f91-13c7-4ddd-a40e-2278f164a413 req-8f76c62f-042e-407f-9529-5900756284b9 tempest-AttachVolumeNegativeTest-1258960963 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d', 'name': 'volume-f3b09ae4-2582-49f3-aad8-ee0f6cf89c15', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a80e7ae-e5ea-4721-a513-a072faae47a2', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 07 18:11:25 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5dce3f2b-d6db-4944-b475-cf4d036de03a tempest-CinderUnicodeTest-71289627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459.6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f" returned: 0 in 0.297s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5dce3f2b-d6db-4944-b475-cf4d036de03a tempest-CinderUnicodeTest-71289627 None] Lock "cinder-quobyte-6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f" released by "_delete_snapshot" :: held 2.073s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5dce3f2b-d6db-4944-b475-cf4d036de03a tempest-CinderUnicodeTest-71289627 None] Lock "cinder-quobyte-e85683a6-5d98-4403-9ff1-168569f3a459" released by "delete_snapshot" :: held 2.104s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:25 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-a1c83f91-13c7-4ddd-a40e-2278f164a413 req-8f76c62f-042e-407f-9529-5900756284b9 tempest-AttachVolumeNegativeTest-1258960963 None] attachment_update completed successfully.
Sep 07 18:11:25 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-5dce3f2b-d6db-4944-b475-cf4d036de03a tempest-CinderUnicodeTest-71289627 None] Created reservations ['22bacbc3-8625-4be9-9a39-9310c01662a0', '5060e220-bf95-43b4-991f-5d54eb44c378', 'e2433bf0-a2ed-4825-a18d-a25ad5bfaa26', '652889b3-551b-4b30-b437-be647f6279b6'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:11:25 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5dce3f2b-d6db-4944-b475-cf4d036de03a tempest-CinderUnicodeTest-71289627 None] Delete snapshot completed successfully.
Sep 07 18:11:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5dce3f2b-d6db-4944-b475-cf4d036de03a tempest-CinderUnicodeTest-71289627 None] Lock "cinder-6a2c6ec0-5c45-4bc4-861f-3c7736bbf15f-delete_snapshot" released by "delete_snapshot" :: held 2.285s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab7f73dd-222c-4858-a746-0c7bca9ff301 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab7f73dd-222c-4858-a746-0c7bca9ff301 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ab7f73dd-222c-4858-a746-0c7bca9ff301 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Creating offline snapshot 78f89f18-0c84-406f-8084-1f075f26544d of volume a37871ac-fd8a-46f6-9544-f9164d3d40d2 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:11:26 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6ba90a-ea41-4b29-8b6e-aae4b08e95be]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:11:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab7f73dd-222c-4858-a746-0c7bca9ff301 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:26 devstack sudo[100014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2
Sep 07 18:11:26 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e17c8ab6-3179-47b3-83be-923e105ee013 tempest-CinderUnicodeTest-71289627 None] Acquiring lock "cinder-e85683a6-5d98-4403-9ff1-168569f3a459-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e17c8ab6-3179-47b3-83be-923e105ee013 tempest-CinderUnicodeTest-71289627 None] Lock "cinder-e85683a6-5d98-4403-9ff1-168569f3a459-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e17c8ab6-3179-47b3-83be-923e105ee013 tempest-CinderUnicodeTest-71289627 None] Acquiring lock "cinder-quobyte-e85683a6-5d98-4403-9ff1-168569f3a459" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e17c8ab6-3179-47b3-83be-923e105ee013 tempest-CinderUnicodeTest-71289627 None] Lock "cinder-quobyte-e85683a6-5d98-4403-9ff1-168569f3a459" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:26 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba6f014-9556-4b1a-a271-5a64f453acb3]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:11:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e17c8ab6-3179-47b3-83be-923e105ee013 tempest-CinderUnicodeTest-71289627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:26 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab7f73dd-222c-4858-a746-0c7bca9ff301 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2" returned: 0 in 0.457s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab7f73dd-222c-4858-a746-0c7bca9ff301 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2.78f89f18-0c84-406f-8084-1f075f26544d 2G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:26 devstack sudo[100020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2.78f89f18-0c84-406f-8084-1f075f26544d 2G
Sep 07 18:11:26 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:27 devstack sudo[100019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459
Sep 07 18:11:27 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:27 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e17c8ab6-3179-47b3-83be-923e105ee013 tempest-CinderUnicodeTest-71289627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459" returned: 0 in 0.510s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e17c8ab6-3179-47b3-83be-923e105ee013 tempest-CinderUnicodeTest-71289627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:27 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab7f73dd-222c-4858-a746-0c7bca9ff301 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2.78f89f18-0c84-406f-8084-1f075f26544d 2G" returned: 0 in 0.517s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab7f73dd-222c-4858-a746-0c7bca9ff301 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2.78f89f18-0c84-406f-8084-1f075f26544d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:27 devstack sudo[100031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459
Sep 07 18:11:27 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:27 devstack sudo[100033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2.78f89f18-0c84-406f-8084-1f075f26544d
Sep 07 18:11:27 devstack sudo[100033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:27 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e17c8ab6-3179-47b3-83be-923e105ee013 tempest-CinderUnicodeTest-71289627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e85683a6-5d98-4403-9ff1-168569f3a459" returned: 0 in 0.476s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e17c8ab6-3179-47b3-83be-923e105ee013 tempest-CinderUnicodeTest-71289627 None] Lock "cinder-quobyte-e85683a6-5d98-4403-9ff1-168569f3a459" released by "delete_volume" :: held 1.059s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:27 devstack sudo[100033]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab7f73dd-222c-4858-a746-0c7bca9ff301 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2.78f89f18-0c84-406f-8084-1f075f26544d" returned: 0 in 0.482s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:27 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-ab7f73dd-222c-4858-a746-0c7bca9ff301 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2.78f89f18-0c84-406f-8084-1f075f26544d is being set with open permissions: ugo+rw
Sep 07 18:11:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab7f73dd-222c-4858-a746-0c7bca9ff301 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2.78f89f18-0c84-406f-8084-1f075f26544d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:28 devstack sudo[100039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2.78f89f18-0c84-406f-8084-1f075f26544d
Sep 07 18:11:28 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:28 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-e17c8ab6-3179-47b3-83be-923e105ee013 tempest-CinderUnicodeTest-71289627 None] Created reservations ['8a3a7dc5-67b8-488d-8eee-17e75c745c96', 'e27b9799-fb8b-4ac0-a5ff-2abeb7919273', '8b60c3b2-85f5-4e31-8a71-4f41f699cb01', '0a8009a2-b9c5-47ad-8200-13c00f5fb581'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:11:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e17c8ab6-3179-47b3-83be-923e105ee013 tempest-CinderUnicodeTest-71289627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e17c8ab6-3179-47b3-83be-923e105ee013 tempest-CinderUnicodeTest-71289627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e17c8ab6-3179-47b3-83be-923e105ee013 tempest-CinderUnicodeTest-71289627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:11:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e17c8ab6-3179-47b3-83be-923e105ee013 tempest-CinderUnicodeTest-71289627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:11:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e17c8ab6-3179-47b3-83be-923e105ee013 tempest-CinderUnicodeTest-71289627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e17c8ab6-3179-47b3-83be-923e105ee013 tempest-CinderUnicodeTest-71289627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:28 devstack sudo[100041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:11:28 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:28 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab7f73dd-222c-4858-a746-0c7bca9ff301 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2.78f89f18-0c84-406f-8084-1f075f26544d" returned: 0 in 0.431s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab7f73dd-222c-4858-a746-0c7bca9ff301 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:28 devstack sudo[100044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2.info
Sep 07 18:11:28 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e17c8ab6-3179-47b3-83be-923e105ee013 tempest-CinderUnicodeTest-71289627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.358s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:28 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:28 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-e17c8ab6-3179-47b3-83be-923e105ee013 tempest-CinderUnicodeTest-71289627 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:11:28 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e17c8ab6-3179-47b3-83be-923e105ee013 tempest-CinderUnicodeTest-71289627 None] Deleted volume successfully.
Sep 07 18:11:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e17c8ab6-3179-47b3-83be-923e105ee013 tempest-CinderUnicodeTest-71289627 None] Lock "cinder-e85683a6-5d98-4403-9ff1-168569f3a459-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:28 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-647a24f7-219a-4a2b-b262-91228b9faf67 req-f6298846-a669-47ba-ab1d-faaec62dc44b tempest-AttachVolumeNegativeTest-1258960963 None] Terminate volume connection completed successfully.
Sep 07 18:11:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-647a24f7-219a-4a2b-b262-91228b9faf67 req-f6298846-a669-47ba-ab1d-faaec62dc44b tempest-AttachVolumeNegativeTest-1258960963 None] Deleting attachment 3a80e7ae-e5ea-4721-a513-a072faae47a2. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 07 18:11:28 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab7f73dd-222c-4858-a746-0c7bca9ff301 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2.info" returned: 0 in 0.346s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:28 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-ab7f73dd-222c-4858-a746-0c7bca9ff301 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2.info is being set with open permissions: ugo+rw
Sep 07 18:11:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab7f73dd-222c-4858-a746-0c7bca9ff301 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:28 devstack sudo[100074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2.info
Sep 07 18:11:28 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d5c157f9-01f3-4b2b-b48c-43abb06ecdb2 tempest-CinderUnicodeTest-71289627 None] Acquiring lock "cinder-ee74f9f4-052e-40b0-807a-c4268b222187-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:29 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab7f73dd-222c-4858-a746-0c7bca9ff301 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2.info" returned: 0 in 0.319s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab7f73dd-222c-4858-a746-0c7bca9ff301 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.672s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d5c157f9-01f3-4b2b-b48c-43abb06ecdb2 tempest-CinderUnicodeTest-71289627 None] Lock "cinder-ee74f9f4-052e-40b0-807a-c4268b222187-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:29 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ab7f73dd-222c-4858-a746-0c7bca9ff301 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Create snapshot completed successfully
Sep 07 18:11:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d5c157f9-01f3-4b2b-b48c-43abb06ecdb2 tempest-CinderUnicodeTest-71289627 None] Acquiring lock "cinder-quobyte-ee74f9f4-052e-40b0-807a-c4268b222187" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d5c157f9-01f3-4b2b-b48c-43abb06ecdb2 tempest-CinderUnicodeTest-71289627 None] Lock "cinder-quobyte-ee74f9f4-052e-40b0-807a-c4268b222187" acquired by "delete_volume" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:29 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ce8396-01fa-43be-8b3d-ee2e037adbc5]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:11:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d5c157f9-01f3-4b2b-b48c-43abb06ecdb2 tempest-CinderUnicodeTest-71289627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ee74f9f4-052e-40b0-807a-c4268b222187 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:29 devstack sudo[100077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ee74f9f4-052e-40b0-807a-c4268b222187
Sep 07 18:11:29 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:29 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d5c157f9-01f3-4b2b-b48c-43abb06ecdb2 tempest-CinderUnicodeTest-71289627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ee74f9f4-052e-40b0-807a-c4268b222187" returned: 0 in 0.533s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d5c157f9-01f3-4b2b-b48c-43abb06ecdb2 tempest-CinderUnicodeTest-71289627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ee74f9f4-052e-40b0-807a-c4268b222187 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:29 devstack sudo[100083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ee74f9f4-052e-40b0-807a-c4268b222187
Sep 07 18:11:29 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2e30bc4b-c699-401e-b83d-9240efa9308e tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Acquiring lock "cinder-78f89f18-0c84-406f-8084-1f075f26544d-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2e30bc4b-c699-401e-b83d-9240efa9308e tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Lock "cinder-78f89f18-0c84-406f-8084-1f075f26544d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2e30bc4b-c699-401e-b83d-9240efa9308e tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Acquiring lock "cinder-quobyte-a37871ac-fd8a-46f6-9544-f9164d3d40d2" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2e30bc4b-c699-401e-b83d-9240efa9308e tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Lock "cinder-quobyte-a37871ac-fd8a-46f6-9544-f9164d3d40d2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2e30bc4b-c699-401e-b83d-9240efa9308e tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Acquiring lock "cinder-quobyte-78f89f18-0c84-406f-8084-1f075f26544d" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2e30bc4b-c699-401e-b83d-9240efa9308e tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Lock "cinder-quobyte-78f89f18-0c84-406f-8084-1f075f26544d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-2e30bc4b-c699-401e-b83d-9240efa9308e tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Deleting offline snapshot 78f89f18-0c84-406f-8084-1f075f26544d of volume a37871ac-fd8a-46f6-9544-f9164d3d40d2 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:11:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-2e30bc4b-c699-401e-b83d-9240efa9308e tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] snapshot_file for this snap is: volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2.78f89f18-0c84-406f-8084-1f075f26544d {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:11:29 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d10da34-2849-4da3-a17c-ef92315d6275]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:11:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e30bc4b-c699-401e-b83d-9240efa9308e tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2.78f89f18-0c84-406f-8084-1f075f26544d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:30 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d5c157f9-01f3-4b2b-b48c-43abb06ecdb2 tempest-CinderUnicodeTest-71289627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ee74f9f4-052e-40b0-807a-c4268b222187" returned: 0 in 0.503s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:30 devstack sudo[100089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2.78f89f18-0c84-406f-8084-1f075f26544d
Sep 07 18:11:30 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d5c157f9-01f3-4b2b-b48c-43abb06ecdb2 tempest-CinderUnicodeTest-71289627 None] Lock "cinder-quobyte-ee74f9f4-052e-40b0-807a-c4268b222187" released by "delete_volume" :: held 1.106s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:30 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-d5c157f9-01f3-4b2b-b48c-43abb06ecdb2 tempest-CinderUnicodeTest-71289627 None] Created reservations ['541b6c94-d37a-4b12-bbeb-0949f8355a99', '1114900a-37cb-4203-9f70-de3461a60abe', 'da283cd5-fdaa-4001-8121-6142d756325f', '316e5042-0968-42bf-bd43-96e3a46ea026'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:11:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d5c157f9-01f3-4b2b-b48c-43abb06ecdb2 tempest-CinderUnicodeTest-71289627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d5c157f9-01f3-4b2b-b48c-43abb06ecdb2 tempest-CinderUnicodeTest-71289627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d5c157f9-01f3-4b2b-b48c-43abb06ecdb2 tempest-CinderUnicodeTest-71289627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:11:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d5c157f9-01f3-4b2b-b48c-43abb06ecdb2 tempest-CinderUnicodeTest-71289627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:11:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d5c157f9-01f3-4b2b-b48c-43abb06ecdb2 tempest-CinderUnicodeTest-71289627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d5c157f9-01f3-4b2b-b48c-43abb06ecdb2 tempest-CinderUnicodeTest-71289627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:30 devstack sudo[100107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:11:30 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:30 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e30bc4b-c699-401e-b83d-9240efa9308e tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2.78f89f18-0c84-406f-8084-1f075f26544d" returned: 0 in 0.718s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-2e30bc4b-c699-401e-b83d-9240efa9308e tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:11:30 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c4312f-9bd4-4f04-b95e-561e2d54760a]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:11:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e30bc4b-c699-401e-b83d-9240efa9308e tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:30 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d5c157f9-01f3-4b2b-b48c-43abb06ecdb2 tempest-CinderUnicodeTest-71289627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.297s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:30 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-d5c157f9-01f3-4b2b-b48c-43abb06ecdb2 tempest-CinderUnicodeTest-71289627 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:11:30 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d5c157f9-01f3-4b2b-b48c-43abb06ecdb2 tempest-CinderUnicodeTest-71289627 None] Deleted volume successfully.
Sep 07 18:11:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d5c157f9-01f3-4b2b-b48c-43abb06ecdb2 tempest-CinderUnicodeTest-71289627 None] Lock "cinder-ee74f9f4-052e-40b0-807a-c4268b222187-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:30 devstack sudo[100114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2
Sep 07 18:11:30 devstack sudo[100114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:31 devstack sudo[100114]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e30bc4b-c699-401e-b83d-9240efa9308e tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2" returned: 0 in 0.462s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e30bc4b-c699-401e-b83d-9240efa9308e tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2.78f89f18-0c84-406f-8084-1f075f26544d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:31 devstack sudo[100119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2.78f89f18-0c84-406f-8084-1f075f26544d
Sep 07 18:11:31 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:31 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e30bc4b-c699-401e-b83d-9240efa9308e tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2.78f89f18-0c84-406f-8084-1f075f26544d" returned: 0 in 0.476s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e30bc4b-c699-401e-b83d-9240efa9308e tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2.78f89f18-0c84-406f-8084-1f075f26544d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:31 devstack sudo[100126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2.78f89f18-0c84-406f-8084-1f075f26544d
Sep 07 18:11:31 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:31 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:11:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Flow 'volume_create_manager' (12a87bc9-8cc0-4e34-8299-060fb7bfd583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:11:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54cf4ae-ba25-4d17-b201-9b3f26db2415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f54cf4ae-ba25-4d17-b201-9b3f26db2415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-278418994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f6df7a-566d-4d64-905f-5c33fc65d3f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4630a1dd241747cc9665572ded1c9754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:11:32Z,use_quota=True,user_id='4e8d5be4564a40768fb1aff20d8aef5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89a0698c-dd0c-4d1c-8131-a5c578230a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89a0698c-dd0c-4d1c-8131-a5c578230a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe587af7-fb88-40d1-8560-9bfbc65d6d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe587af7-fb88-40d1-8560-9bfbc65d6d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00f6df7a-566d-4d64-905f-5c33fc65d3f6', 'volume_name': 'volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0546f2f-1587-4622-9fe8-70294f068b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0546f2f-1587-4622-9fe8-70294f068b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a645acc2-8e54-480c-8cf2-dfe10aef3014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:31 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Volume 00f6df7a-566d-4d64-905f-5c33fc65d3f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6', 'volume_size': 1}
Sep 07 18:11:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-278418994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f6df7a-566d-4d64-905f-5c33fc65d3f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4630a1dd241747cc9665572ded1c9754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:11:32Z,use_quota=True,user_id='4e8d5be4564a40768fb1aff20d8aef5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:11:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Creating volume 00f6df7a-566d-4d64-905f-5c33fc65d3f6 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:11:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:11:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:11:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:11:31 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:11:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:32 devstack sudo[100128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6 1073741824
Sep 07 18:11:32 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:32 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2e30bc4b-c699-401e-b83d-9240efa9308e tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2.78f89f18-0c84-406f-8084-1f075f26544d" returned: 0 in 0.418s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2e30bc4b-c699-401e-b83d-9240efa9308e tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Lock "cinder-quobyte-78f89f18-0c84-406f-8084-1f075f26544d" released by "_delete_snapshot" :: held 2.240s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2e30bc4b-c699-401e-b83d-9240efa9308e tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Lock "cinder-quobyte-a37871ac-fd8a-46f6-9544-f9164d3d40d2" released by "delete_snapshot" :: held 2.270s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:32 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-2e30bc4b-c699-401e-b83d-9240efa9308e tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Created reservations ['465bdc9a-d19e-4851-92fa-586d89dcc039', 'dd4b8e39-bb89-4f3c-8d37-631b72347f3a', '99ab536f-003c-4b83-b2cd-45372478aaf3', 'a766bf7f-96fc-4ea1-ae45-e6ca51fae9f0'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:11:32 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2e30bc4b-c699-401e-b83d-9240efa9308e tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Delete snapshot completed successfully.
Sep 07 18:11:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2e30bc4b-c699-401e-b83d-9240efa9308e tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Lock "cinder-78f89f18-0c84-406f-8084-1f075f26544d-delete_snapshot" released by "delete_snapshot" :: held 2.428s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:32 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6 1073741824" returned: 0 in 0.551s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:32 devstack sudo[100138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6
Sep 07 18:11:32 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:32 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6" returned: 0 in 0.313s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:11:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a645acc2-8e54-480c-8cf2-dfe10aef3014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d15d1804-1443-455d-8c94-8cbe0d3b98b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:32 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Volume volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6 (00f6df7a-566d-4d64-905f-5c33fc65d3f6): created successfully
Sep 07 18:11:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d15d1804-1443-455d-8c94-8cbe0d3b98b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Flow 'volume_create_manager' (12a87bc9-8cc0-4e34-8299-060fb7bfd583) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:11:32 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ad88f2bd-0005-4c0e-a349-77ca4e070544 tempest-TestStampPattern-2010018532 None] Created volume successfully.
Sep 07 18:11:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-95d89d01-697a-48af-adde-32e536147e73 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Acquiring lock "cinder-a37871ac-fd8a-46f6-9544-f9164d3d40d2-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-95d89d01-697a-48af-adde-32e536147e73 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Lock "cinder-a37871ac-fd8a-46f6-9544-f9164d3d40d2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-95d89d01-697a-48af-adde-32e536147e73 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Acquiring lock "cinder-quobyte-a37871ac-fd8a-46f6-9544-f9164d3d40d2" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-95d89d01-697a-48af-adde-32e536147e73 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Lock "cinder-quobyte-a37871ac-fd8a-46f6-9544-f9164d3d40d2" acquired by "delete_volume" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:33 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28f8748-2550-400c-9eee-ebd3cf4c2d6b]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:11:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-95d89d01-697a-48af-adde-32e536147e73 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:33 devstack sudo[100142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2
Sep 07 18:11:33 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:33 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-95d89d01-697a-48af-adde-32e536147e73 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2" returned: 0 in 0.541s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-95d89d01-697a-48af-adde-32e536147e73 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:33 devstack sudo[100147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2
Sep 07 18:11:33 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:34 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-95d89d01-697a-48af-adde-32e536147e73 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a37871ac-fd8a-46f6-9544-f9164d3d40d2" returned: 0 in 0.327s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-95d89d01-697a-48af-adde-32e536147e73 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Lock "cinder-quobyte-a37871ac-fd8a-46f6-9544-f9164d3d40d2" released by "delete_volume" :: held 0.947s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:34 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-95d89d01-697a-48af-adde-32e536147e73 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Created reservations ['e0bd933a-6b60-4828-96ab-0761c8f0e423', 'a34399e2-2e40-4cf3-b194-d592272a81fa', '7549c9a4-6997-494d-8e1d-99ca65abc431', '72823239-fb29-4e43-a69b-9bbc6b6b4efc'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:11:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-95d89d01-697a-48af-adde-32e536147e73 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-95d89d01-697a-48af-adde-32e536147e73 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-95d89d01-697a-48af-adde-32e536147e73 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:11:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-95d89d01-697a-48af-adde-32e536147e73 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:11:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-95d89d01-697a-48af-adde-32e536147e73 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-95d89d01-697a-48af-adde-32e536147e73 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:34 devstack sudo[100153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:11:34 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:34 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-95d89d01-697a-48af-adde-32e536147e73 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.314s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:34 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-95d89d01-697a-48af-adde-32e536147e73 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:11:34 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-95d89d01-697a-48af-adde-32e536147e73 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Deleted volume successfully.
Sep 07 18:11:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-95d89d01-697a-48af-adde-32e536147e73 tempest-VolumesSnapshotNegativeTestJSON-1732878231 None] Lock "cinder-a37871ac-fd8a-46f6-9544-f9164d3d40d2-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e035af16-72c2-4994-9dda-ae37b7bd55d2 tempest-AttachVolumeNegativeTest-1258960963 None] Acquiring lock "cinder-f3b09ae4-2582-49f3-aad8-ee0f6cf89c15-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e035af16-72c2-4994-9dda-ae37b7bd55d2 tempest-AttachVolumeNegativeTest-1258960963 None] Lock "cinder-f3b09ae4-2582-49f3-aad8-ee0f6cf89c15-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e035af16-72c2-4994-9dda-ae37b7bd55d2 tempest-AttachVolumeNegativeTest-1258960963 None] Acquiring lock "cinder-quobyte-f3b09ae4-2582-49f3-aad8-ee0f6cf89c15" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e035af16-72c2-4994-9dda-ae37b7bd55d2 tempest-AttachVolumeNegativeTest-1258960963 None] Lock "cinder-quobyte-f3b09ae4-2582-49f3-aad8-ee0f6cf89c15" acquired by "delete_volume" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:36 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[182fd0a1-27b3-433e-85b8-4e166b1a8508]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:11:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e035af16-72c2-4994-9dda-ae37b7bd55d2 tempest-AttachVolumeNegativeTest-1258960963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f3b09ae4-2582-49f3-aad8-ee0f6cf89c15 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:36 devstack sudo[100160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f3b09ae4-2582-49f3-aad8-ee0f6cf89c15
Sep 07 18:11:36 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:36 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e035af16-72c2-4994-9dda-ae37b7bd55d2 tempest-AttachVolumeNegativeTest-1258960963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f3b09ae4-2582-49f3-aad8-ee0f6cf89c15" returned: 0 in 0.682s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e035af16-72c2-4994-9dda-ae37b7bd55d2 tempest-AttachVolumeNegativeTest-1258960963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f3b09ae4-2582-49f3-aad8-ee0f6cf89c15 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:36 devstack sudo[100182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f3b09ae4-2582-49f3-aad8-ee0f6cf89c15
Sep 07 18:11:36 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:37 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e035af16-72c2-4994-9dda-ae37b7bd55d2 tempest-AttachVolumeNegativeTest-1258960963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f3b09ae4-2582-49f3-aad8-ee0f6cf89c15" returned: 0 in 0.370s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e035af16-72c2-4994-9dda-ae37b7bd55d2 tempest-AttachVolumeNegativeTest-1258960963 None] Lock "cinder-quobyte-f3b09ae4-2582-49f3-aad8-ee0f6cf89c15" released by "delete_volume" :: held 1.099s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-e035af16-72c2-4994-9dda-ae37b7bd55d2 tempest-AttachVolumeNegativeTest-1258960963 None] Created reservations ['e34c6f2b-b1fc-417a-ab7f-3bce1aa8e13f', '2bba2173-ad99-4f1e-b10a-ce1c4b2a0a06', 'e4795a3d-a01a-49dc-9bbd-0938899cbfa7', 'c65a2a74-b0d3-49ee-8320-eb41edc63da7'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Flow 'volume_create_manager' (39e93a07-5805-4691-9c31-fa71da88a60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c00f17d-a55f-4ee4-95fa-fbdaf4f4574e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c00f17d-a55f-4ee4-95fa-fbdaf4f4574e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1994956272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7960a16d-71e1-4d10-92b4-92999e5f72cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14736c37f83347d4ba0a2a5aa75ba553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:11:37Z,use_quota=True,user_id='728bd200dc45435285fee7ee558c7bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c017751-158a-4c50-af99-d72bcf8ebc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c017751-158a-4c50-af99-d72bcf8ebc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (292f6e9a-06de-4d4f-ad2f-10d100a469c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (292f6e9a-06de-4d4f-ad2f-10d100a469c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7960a16d-71e1-4d10-92b4-92999e5f72cd', 'volume_name': 'volume-7960a16d-71e1-4d10-92b4-92999e5f72cd', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab1d31a1-db3c-45e9-bc98-43816494048a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab1d31a1-db3c-45e9-bc98-43816494048a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261248f2-83ad-481b-914c-96ee6a840ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:37 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Volume 7960a16d-71e1-4d10-92b4-92999e5f72cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7960a16d-71e1-4d10-92b4-92999e5f72cd', 'volume_size': 1}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1994956272',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7960a16d-71e1-4d10-92b4-92999e5f72cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14736c37f83347d4ba0a2a5aa75ba553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:11:37Z,use_quota=True,user_id='728bd200dc45435285fee7ee558c7bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Creating volume 7960a16d-71e1-4d10-92b4-92999e5f72cd {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:11:37 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7960a16d-71e1-4d10-92b4-92999e5f72cd 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:37 devstack sudo[100185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7960a16d-71e1-4d10-92b4-92999e5f72cd 1073741824
Sep 07 18:11:37 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e035af16-72c2-4994-9dda-ae37b7bd55d2 tempest-AttachVolumeNegativeTest-1258960963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e035af16-72c2-4994-9dda-ae37b7bd55d2 tempest-AttachVolumeNegativeTest-1258960963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e035af16-72c2-4994-9dda-ae37b7bd55d2 tempest-AttachVolumeNegativeTest-1258960963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e035af16-72c2-4994-9dda-ae37b7bd55d2 tempest-AttachVolumeNegativeTest-1258960963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e035af16-72c2-4994-9dda-ae37b7bd55d2 tempest-AttachVolumeNegativeTest-1258960963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e035af16-72c2-4994-9dda-ae37b7bd55d2 tempest-AttachVolumeNegativeTest-1258960963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:37 devstack sudo[100187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:11:37 devstack sudo[100187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:37 devstack sudo[100187]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e035af16-72c2-4994-9dda-ae37b7bd55d2 tempest-AttachVolumeNegativeTest-1258960963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.380s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-e035af16-72c2-4994-9dda-ae37b7bd55d2 tempest-AttachVolumeNegativeTest-1258960963 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:11:37 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e035af16-72c2-4994-9dda-ae37b7bd55d2 tempest-AttachVolumeNegativeTest-1258960963 None] Deleted volume successfully.
Sep 07 18:11:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e035af16-72c2-4994-9dda-ae37b7bd55d2 tempest-AttachVolumeNegativeTest-1258960963 None] Lock "cinder-f3b09ae4-2582-49f3-aad8-ee0f6cf89c15-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:38 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7960a16d-71e1-4d10-92b4-92999e5f72cd 1073741824" returned: 0 in 0.701s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7960a16d-71e1-4d10-92b4-92999e5f72cd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:38 devstack sudo[100195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7960a16d-71e1-4d10-92b4-92999e5f72cd
Sep 07 18:11:38 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:38 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7960a16d-71e1-4d10-92b4-92999e5f72cd" returned: 0 in 0.288s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:11:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261248f2-83ad-481b-914c-96ee6a840ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7960a16d-71e1-4d10-92b4-92999e5f72cd', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7412293e-1988-4323-9165-08b58b07213b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:38 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Volume volume-7960a16d-71e1-4d10-92b4-92999e5f72cd (7960a16d-71e1-4d10-92b4-92999e5f72cd): created successfully
Sep 07 18:11:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7412293e-1988-4323-9165-08b58b07213b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Flow 'volume_create_manager' (39e93a07-5805-4691-9c31-fa71da88a60f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:11:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-19f119eb-0f5b-4d62-b0d1-5905e9e00ae2 tempest-AttachVolumeNegativeTest-1258960963 None] Acquiring lock "cinder-8cebee19-24df-48a7-8e73-3eda8aea7ebd-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:38 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4f0ceb81-6f31-4ce5-9c77-91509c7c99ad tempest-ProjectReaderTests-617203195 None] Created volume successfully.
Sep 07 18:11:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-19f119eb-0f5b-4d62-b0d1-5905e9e00ae2 tempest-AttachVolumeNegativeTest-1258960963 None] Lock "cinder-8cebee19-24df-48a7-8e73-3eda8aea7ebd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-19f119eb-0f5b-4d62-b0d1-5905e9e00ae2 tempest-AttachVolumeNegativeTest-1258960963 None] Acquiring lock "cinder-quobyte-8cebee19-24df-48a7-8e73-3eda8aea7ebd" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-19f119eb-0f5b-4d62-b0d1-5905e9e00ae2 tempest-AttachVolumeNegativeTest-1258960963 None] Lock "cinder-quobyte-8cebee19-24df-48a7-8e73-3eda8aea7ebd" acquired by "delete_volume" :: waited 0.027s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:38 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad5644e-c036-463f-be06-615ea72596d7]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:11:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-19f119eb-0f5b-4d62-b0d1-5905e9e00ae2 tempest-AttachVolumeNegativeTest-1258960963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8cebee19-24df-48a7-8e73-3eda8aea7ebd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:38 devstack sudo[100198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8cebee19-24df-48a7-8e73-3eda8aea7ebd
Sep 07 18:11:38 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:39 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-19f119eb-0f5b-4d62-b0d1-5905e9e00ae2 tempest-AttachVolumeNegativeTest-1258960963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8cebee19-24df-48a7-8e73-3eda8aea7ebd" returned: 0 in 0.516s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-19f119eb-0f5b-4d62-b0d1-5905e9e00ae2 tempest-AttachVolumeNegativeTest-1258960963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8cebee19-24df-48a7-8e73-3eda8aea7ebd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:39 devstack sudo[100204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8cebee19-24df-48a7-8e73-3eda8aea7ebd
Sep 07 18:11:39 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:39 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-19f119eb-0f5b-4d62-b0d1-5905e9e00ae2 tempest-AttachVolumeNegativeTest-1258960963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8cebee19-24df-48a7-8e73-3eda8aea7ebd" returned: 0 in 0.439s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-19f119eb-0f5b-4d62-b0d1-5905e9e00ae2 tempest-AttachVolumeNegativeTest-1258960963 None] Lock "cinder-quobyte-8cebee19-24df-48a7-8e73-3eda8aea7ebd" released by "delete_volume" :: held 1.036s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5278ced8-9434-4843-96d9-43b737775264 tempest-ProjectReaderTests-617203195 None] Acquiring lock "cinder-7960a16d-71e1-4d10-92b4-92999e5f72cd-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5278ced8-9434-4843-96d9-43b737775264 tempest-ProjectReaderTests-617203195 None] Lock "cinder-7960a16d-71e1-4d10-92b4-92999e5f72cd-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5278ced8-9434-4843-96d9-43b737775264 tempest-ProjectReaderTests-617203195 None] Acquiring lock "cinder-quobyte-7960a16d-71e1-4d10-92b4-92999e5f72cd" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:39 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-19f119eb-0f5b-4d62-b0d1-5905e9e00ae2 tempest-AttachVolumeNegativeTest-1258960963 None] Created reservations ['a91a590e-6ef1-4fbf-a4bf-b1f68c6bf945', '112cfbd9-b19a-47d9-b4fb-782825be1144', 'e1ff5417-2edb-4690-8d05-27b270ede5dc', '4553ce64-3886-4077-955c-9ecb53ac9566'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:11:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5278ced8-9434-4843-96d9-43b737775264 tempest-ProjectReaderTests-617203195 None] Lock "cinder-quobyte-7960a16d-71e1-4d10-92b4-92999e5f72cd" acquired by "delete_volume" :: waited 0.050s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:39 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb94c7d-f364-4fc3-8c48-a9b161f1b55d]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:11:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5278ced8-9434-4843-96d9-43b737775264 tempest-ProjectReaderTests-617203195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7960a16d-71e1-4d10-92b4-92999e5f72cd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-19f119eb-0f5b-4d62-b0d1-5905e9e00ae2 tempest-AttachVolumeNegativeTest-1258960963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-19f119eb-0f5b-4d62-b0d1-5905e9e00ae2 tempest-AttachVolumeNegativeTest-1258960963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-19f119eb-0f5b-4d62-b0d1-5905e9e00ae2 tempest-AttachVolumeNegativeTest-1258960963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:11:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-19f119eb-0f5b-4d62-b0d1-5905e9e00ae2 tempest-AttachVolumeNegativeTest-1258960963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:11:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-19f119eb-0f5b-4d62-b0d1-5905e9e00ae2 tempest-AttachVolumeNegativeTest-1258960963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-19f119eb-0f5b-4d62-b0d1-5905e9e00ae2 tempest-AttachVolumeNegativeTest-1258960963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:40 devstack sudo[100259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:11:40 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:40 devstack sudo[100246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7960a16d-71e1-4d10-92b4-92999e5f72cd
Sep 07 18:11:40 devstack sudo[100246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:40 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-19f119eb-0f5b-4d62-b0d1-5905e9e00ae2 tempest-AttachVolumeNegativeTest-1258960963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.588s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:40 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-19f119eb-0f5b-4d62-b0d1-5905e9e00ae2 tempest-AttachVolumeNegativeTest-1258960963 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:11:40 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-19f119eb-0f5b-4d62-b0d1-5905e9e00ae2 tempest-AttachVolumeNegativeTest-1258960963 None] Deleted volume successfully.
Sep 07 18:11:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-19f119eb-0f5b-4d62-b0d1-5905e9e00ae2 tempest-AttachVolumeNegativeTest-1258960963 None] Lock "cinder-8cebee19-24df-48a7-8e73-3eda8aea7ebd-delete_volume" released by "delete_volume" :: held 2.229s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:40 devstack sudo[100246]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5278ced8-9434-4843-96d9-43b737775264 tempest-ProjectReaderTests-617203195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7960a16d-71e1-4d10-92b4-92999e5f72cd" returned: 0 in 0.931s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5278ced8-9434-4843-96d9-43b737775264 tempest-ProjectReaderTests-617203195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7960a16d-71e1-4d10-92b4-92999e5f72cd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:40 devstack sudo[100280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7960a16d-71e1-4d10-92b4-92999e5f72cd
Sep 07 18:11:40 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:41 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5278ced8-9434-4843-96d9-43b737775264 tempest-ProjectReaderTests-617203195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7960a16d-71e1-4d10-92b4-92999e5f72cd" returned: 0 in 0.351s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:41 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f5f967dc-c91d-4f98-8baa-20b0af980c9c tempest-AttachVolumeNegativeTest-1258960963 None] Acquiring lock "cinder-5ccc33a0-db77-4d67-a700-0f2ac8e127ec-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:41 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5278ced8-9434-4843-96d9-43b737775264 tempest-ProjectReaderTests-617203195 None] Lock "cinder-quobyte-7960a16d-71e1-4d10-92b4-92999e5f72cd" released by "delete_volume" :: held 1.399s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:41 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f5f967dc-c91d-4f98-8baa-20b0af980c9c tempest-AttachVolumeNegativeTest-1258960963 None] Lock "cinder-5ccc33a0-db77-4d67-a700-0f2ac8e127ec-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:41 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f5f967dc-c91d-4f98-8baa-20b0af980c9c tempest-AttachVolumeNegativeTest-1258960963 None] Acquiring lock "cinder-quobyte-5ccc33a0-db77-4d67-a700-0f2ac8e127ec" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:41 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-5278ced8-9434-4843-96d9-43b737775264 tempest-ProjectReaderTests-617203195 None] Created reservations ['f3bba535-41f8-4e29-8261-ce0b45f7dccd', 'f7244a35-9421-483e-a9ed-43c869057b76', '580e73f6-7010-4a39-9014-3e07fd1807a6', '25a0be99-c602-434f-9aa6-2e2bf6addfaf'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:11:41 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f5f967dc-c91d-4f98-8baa-20b0af980c9c tempest-AttachVolumeNegativeTest-1258960963 None] Lock "cinder-quobyte-5ccc33a0-db77-4d67-a700-0f2ac8e127ec" acquired by "delete_volume" :: waited 0.044s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:41 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b82255-c411-4ff6-a0b4-77d9554ce8b9]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:11:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f5f967dc-c91d-4f98-8baa-20b0af980c9c tempest-AttachVolumeNegativeTest-1258960963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5ccc33a0-db77-4d67-a700-0f2ac8e127ec {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5278ced8-9434-4843-96d9-43b737775264 tempest-ProjectReaderTests-617203195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5278ced8-9434-4843-96d9-43b737775264 tempest-ProjectReaderTests-617203195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5278ced8-9434-4843-96d9-43b737775264 tempest-ProjectReaderTests-617203195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:11:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5278ced8-9434-4843-96d9-43b737775264 tempest-ProjectReaderTests-617203195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:11:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5278ced8-9434-4843-96d9-43b737775264 tempest-ProjectReaderTests-617203195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5278ced8-9434-4843-96d9-43b737775264 tempest-ProjectReaderTests-617203195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:41 devstack sudo[100288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5ccc33a0-db77-4d67-a700-0f2ac8e127ec
Sep 07 18:11:41 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:41 devstack sudo[100289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:11:41 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:42 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5278ced8-9434-4843-96d9-43b737775264 tempest-ProjectReaderTests-617203195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.413s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-5278ced8-9434-4843-96d9-43b737775264 tempest-ProjectReaderTests-617203195 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:11:42 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5278ced8-9434-4843-96d9-43b737775264 tempest-ProjectReaderTests-617203195 None] Deleted volume successfully.
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5278ced8-9434-4843-96d9-43b737775264 tempest-ProjectReaderTests-617203195 None] Lock "cinder-7960a16d-71e1-4d10-92b4-92999e5f72cd-delete_volume" released by "delete_volume" :: held 2.509s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:42 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f5f967dc-c91d-4f98-8baa-20b0af980c9c tempest-AttachVolumeNegativeTest-1258960963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5ccc33a0-db77-4d67-a700-0f2ac8e127ec" returned: 0 in 0.694s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f5f967dc-c91d-4f98-8baa-20b0af980c9c tempest-AttachVolumeNegativeTest-1258960963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5ccc33a0-db77-4d67-a700-0f2ac8e127ec {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:42 devstack sudo[100297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5ccc33a0-db77-4d67-a700-0f2ac8e127ec
Sep 07 18:11:42 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:42 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f5f967dc-c91d-4f98-8baa-20b0af980c9c tempest-AttachVolumeNegativeTest-1258960963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5ccc33a0-db77-4d67-a700-0f2ac8e127ec" returned: 0 in 0.426s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f5f967dc-c91d-4f98-8baa-20b0af980c9c tempest-AttachVolumeNegativeTest-1258960963 None] Lock "cinder-quobyte-5ccc33a0-db77-4d67-a700-0f2ac8e127ec" released by "delete_volume" :: held 1.229s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Flow 'volume_create_manager' (fa22ab32-dfa3-4371-a645-bc042ce76411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb47b83c-7ecb-4093-ab76-5c10c249f82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-f5f967dc-c91d-4f98-8baa-20b0af980c9c tempest-AttachVolumeNegativeTest-1258960963 None] Created reservations ['fa964802-4de2-49c0-96e2-23c1d567652b', 'e9447ccf-7e24-4b03-a241-087cb5cf09c0', 'a3e17039-75f8-40bc-89d4-7a7915c6cc3b', '20baa2b5-1343-44a8-881c-c83024a4e3d2'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb47b83c-7ecb-4093-ab76-5c10c249f82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1021063851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee488438-5c99-4312-8581-96862c8950ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14736c37f83347d4ba0a2a5aa75ba553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:11:43Z,use_quota=True,user_id='728bd200dc45435285fee7ee558c7bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (334367b4-717e-4307-b1f2-baddf52a56b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (334367b4-717e-4307-b1f2-baddf52a56b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04cf1bbe-f9ea-4c95-9615-4b6a678c2f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04cf1bbe-f9ea-4c95-9615-4b6a678c2f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee488438-5c99-4312-8581-96862c8950ee', 'volume_name': 'volume-ee488438-5c99-4312-8581-96862c8950ee', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5508308f-69d6-4370-8794-daee5e0e7622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5508308f-69d6-4370-8794-daee5e0e7622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2701262-707a-4cb9-9eda-e20a478dfbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:42 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Volume ee488438-5c99-4312-8581-96862c8950ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee488438-5c99-4312-8581-96862c8950ee', 'volume_size': 1}
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1021063851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee488438-5c99-4312-8581-96862c8950ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14736c37f83347d4ba0a2a5aa75ba553',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:11:43Z,use_quota=True,user_id='728bd200dc45435285fee7ee558c7bc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Creating volume ee488438-5c99-4312-8581-96862c8950ee {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:11:42 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:11:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ee488438-5c99-4312-8581-96862c8950ee 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:42 devstack sudo[100300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ee488438-5c99-4312-8581-96862c8950ee 1073741824
Sep 07 18:11:42 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f5f967dc-c91d-4f98-8baa-20b0af980c9c tempest-AttachVolumeNegativeTest-1258960963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f5f967dc-c91d-4f98-8baa-20b0af980c9c tempest-AttachVolumeNegativeTest-1258960963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f5f967dc-c91d-4f98-8baa-20b0af980c9c tempest-AttachVolumeNegativeTest-1258960963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:11:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f5f967dc-c91d-4f98-8baa-20b0af980c9c tempest-AttachVolumeNegativeTest-1258960963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:11:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f5f967dc-c91d-4f98-8baa-20b0af980c9c tempest-AttachVolumeNegativeTest-1258960963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f5f967dc-c91d-4f98-8baa-20b0af980c9c tempest-AttachVolumeNegativeTest-1258960963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:43 devstack sudo[100302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:11:43 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:43 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f5f967dc-c91d-4f98-8baa-20b0af980c9c tempest-AttachVolumeNegativeTest-1258960963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.347s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:43 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f5f967dc-c91d-4f98-8baa-20b0af980c9c tempest-AttachVolumeNegativeTest-1258960963 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:11:43 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f5f967dc-c91d-4f98-8baa-20b0af980c9c tempest-AttachVolumeNegativeTest-1258960963 None] Deleted volume successfully.
Sep 07 18:11:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f5f967dc-c91d-4f98-8baa-20b0af980c9c tempest-AttachVolumeNegativeTest-1258960963 None] Lock "cinder-5ccc33a0-db77-4d67-a700-0f2ac8e127ec-delete_volume" released by "delete_volume" :: held 2.142s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:43 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ee488438-5c99-4312-8581-96862c8950ee 1073741824" returned: 0 in 0.675s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ee488438-5c99-4312-8581-96862c8950ee {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:43 devstack sudo[100310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ee488438-5c99-4312-8581-96862c8950ee
Sep 07 18:11:43 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:43 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ee488438-5c99-4312-8581-96862c8950ee" returned: 0 in 0.330s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:11:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2701262-707a-4cb9-9eda-e20a478dfbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee488438-5c99-4312-8581-96862c8950ee', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc3df6cd-587b-4703-8b5e-ac435fb1a712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:44 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Volume volume-ee488438-5c99-4312-8581-96862c8950ee (ee488438-5c99-4312-8581-96862c8950ee): created successfully
Sep 07 18:11:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc3df6cd-587b-4703-8b5e-ac435fb1a712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Flow 'volume_create_manager' (fa22ab32-dfa3-4371-a645-bc042ce76411) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:11:44 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-dd12e187-1014-438e-9765-169626a3d57b tempest-ProjectReaderTests-617203195 None] Created volume successfully.
Sep 07 18:11:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-857e17f5-b574-4243-a405-820bab14d361 tempest-ProjectReaderTests-617203195 None] Acquiring lock "cinder-ee488438-5c99-4312-8581-96862c8950ee-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-857e17f5-b574-4243-a405-820bab14d361 tempest-ProjectReaderTests-617203195 None] Lock "cinder-ee488438-5c99-4312-8581-96862c8950ee-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-857e17f5-b574-4243-a405-820bab14d361 tempest-ProjectReaderTests-617203195 None] Acquiring lock "cinder-quobyte-ee488438-5c99-4312-8581-96862c8950ee" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:11:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-857e17f5-b574-4243-a405-820bab14d361 tempest-ProjectReaderTests-617203195 None] Lock "cinder-quobyte-ee488438-5c99-4312-8581-96862c8950ee" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:11:45 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d317005a-9034-4f14-9a0f-c64f7001dcd7]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:11:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-857e17f5-b574-4243-a405-820bab14d361 tempest-ProjectReaderTests-617203195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ee488438-5c99-4312-8581-96862c8950ee {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:45 devstack sudo[100313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ee488438-5c99-4312-8581-96862c8950ee
Sep 07 18:11:45 devstack sudo[100313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:45 devstack sudo[100313]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-857e17f5-b574-4243-a405-820bab14d361 tempest-ProjectReaderTests-617203195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ee488438-5c99-4312-8581-96862c8950ee" returned: 0 in 0.431s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-857e17f5-b574-4243-a405-820bab14d361 tempest-ProjectReaderTests-617203195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ee488438-5c99-4312-8581-96862c8950ee {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:45 devstack sudo[100318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ee488438-5c99-4312-8581-96862c8950ee
Sep 07 18:11:45 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:45 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-857e17f5-b574-4243-a405-820bab14d361 tempest-ProjectReaderTests-617203195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ee488438-5c99-4312-8581-96862c8950ee" returned: 0 in 0.446s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-857e17f5-b574-4243-a405-820bab14d361 tempest-ProjectReaderTests-617203195 None] Lock "cinder-quobyte-ee488438-5c99-4312-8581-96862c8950ee" released by "delete_volume" :: held 0.939s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:46 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-857e17f5-b574-4243-a405-820bab14d361 tempest-ProjectReaderTests-617203195 None] Created reservations ['f20dd49f-2cf2-4e40-b4ba-a64e4b45b0e3', '6d773cc1-4554-49dc-b143-f3a2bebc6557', '50d2d622-3959-4ac6-b259-e8a5faf21fba', 'ed60899d-87ea-4510-9a7b-a489387e2946'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:11:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-857e17f5-b574-4243-a405-820bab14d361 tempest-ProjectReaderTests-617203195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-857e17f5-b574-4243-a405-820bab14d361 tempest-ProjectReaderTests-617203195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-857e17f5-b574-4243-a405-820bab14d361 tempest-ProjectReaderTests-617203195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:11:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-857e17f5-b574-4243-a405-820bab14d361 tempest-ProjectReaderTests-617203195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:11:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-857e17f5-b574-4243-a405-820bab14d361 tempest-ProjectReaderTests-617203195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-857e17f5-b574-4243-a405-820bab14d361 tempest-ProjectReaderTests-617203195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:46 devstack sudo[100323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:11:46 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:46 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-857e17f5-b574-4243-a405-820bab14d361 tempest-ProjectReaderTests-617203195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.514s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:46 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-857e17f5-b574-4243-a405-820bab14d361 tempest-ProjectReaderTests-617203195 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:11:46 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-857e17f5-b574-4243-a405-820bab14d361 tempest-ProjectReaderTests-617203195 None] Deleted volume successfully.
Sep 07 18:11:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-857e17f5-b574-4243-a405-820bab14d361 tempest-ProjectReaderTests-617203195 None] Lock "cinder-ee488438-5c99-4312-8581-96862c8950ee-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:11:56 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=115,cinder:UPDATE=136,cinder:INSERT=39,cinder:DELETE=12 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:11:56 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=111,cinder:UPDATE=156,cinder:INSERT=39,cinder:DELETE=13 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:11:59 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:11:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Flow 'volume_create_manager' (9d310e4b-46c9-49be-8c39-115322512211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:11:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71171915-0d9d-49dc-8e69-25f493c6b999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71171915-0d9d-49dc-8e69-25f493c6b999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-394166502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1badab-b08d-49c3-a4c3-bb2c49629793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e285bbe791b4a0892cb44fec0c51e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:11:59Z,use_quota=True,user_id='c256436cb21e44cdb549fc4684e6086f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42122811-04c8-4b71-9e6b-7f352711a968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42122811-04c8-4b71-9e6b-7f352711a968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfa63a1c-5c47-462c-a535-cafcaeac64d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfa63a1c-5c47-462c-a535-cafcaeac64d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be1badab-b08d-49c3-a4c3-bb2c49629793', 'volume_name': 'volume-be1badab-b08d-49c3-a4c3-bb2c49629793', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c590aa-03b5-4ef6-af4c-fd3e2ac9c964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c590aa-03b5-4ef6-af4c-fd3e2ac9c964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:11:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb793df0-2ec6-45c3-b4ab-1435e10497e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:11:59 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Volume be1badab-b08d-49c3-a4c3-bb2c49629793: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be1badab-b08d-49c3-a4c3-bb2c49629793', 'volume_size': 1}
Sep 07 18:11:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-394166502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1badab-b08d-49c3-a4c3-bb2c49629793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e285bbe791b4a0892cb44fec0c51e0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:11:59Z,use_quota=True,user_id='c256436cb21e44cdb549fc4684e6086f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:11:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Creating volume be1badab-b08d-49c3-a4c3-bb2c49629793 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:11:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:11:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:11:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:11:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:11:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:11:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:11:59 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:11:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:59 devstack sudo[100358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793 1073741824
Sep 07 18:11:59 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:59 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793 1073741824" returned: 0 in 0.518s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:11:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:11:59 devstack sudo[100364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793
Sep 07 18:11:59 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:11:59 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root
Sep 07 18:11:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793" returned: 0 in 0.277s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:12:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb793df0-2ec6-45c3-b4ab-1435e10497e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be1badab-b08d-49c3-a4c3-bb2c49629793', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efa1aef-85a3-447f-9e6b-999425668a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:00 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Volume volume-be1badab-b08d-49c3-a4c3-bb2c49629793 (be1badab-b08d-49c3-a4c3-bb2c49629793): created successfully
Sep 07 18:12:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efa1aef-85a3-447f-9e6b-999425668a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Flow 'volume_create_manager' (9d310e4b-46c9-49be-8c39-115322512211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:12:00 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-8c525485-e9b1-4c71-bc7c-3a41d4ec1935 req-82cf8160-438c-46da-b2ab-0d2a6da752ed tempest-VolumesSnapshotsTestJSON-275046806 None] Created volume successfully.
Sep 07 18:12:00 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:12:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:12:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:12:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:00 devstack sudo[100367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:12:00 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:01 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.387s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:12:01 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:12:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 07 18:12:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread info: [<_MainThread(MainThread, started 137533762306176)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137533650971072)>, <Thread(Thread-3 (stat_writer), started daemon 137533647226880)>, <Thread(Rabbit-heartbeat, started daemon 137533647437120)>, <Thread(Thread-5 (_runner), started daemon 137533648120896)>, <Thread(Thread-7 (_runner), started daemon 137533648182592)>, <Thread(fd_logger, started daemon 137533644336576)>, <Thread(privsep_reader, started daemon 137533643255424)>, <Thread(tpool_thread_0, started daemon 137533635446464)>, <Thread(tpool_thread_1, started daemon 137533627053760)>, <Thread(tpool_thread_2, started daemon 137533618661056)>, <Thread(tpool_thread_3, started daemon 137533610251968)>, <Thread(tpool_thread_4, started daemon 137533601842880)>, <Thread(tpool_thread_5, started daemon 137533593433792)>, <Thread(tpool_thread_6, started daemon 137533585024704)>, <Thread(tpool_thread_7, started daemon 137533576615616)>, <Thread(tpool_thread_8, started daemon 137533568206528)>, <Thread(tpool_thread_9, started daemon 137533559797440)>, <Thread(tpool_thread_10, started daemon 137533551388352)>, <Thread(tpool_thread_11, started daemon 137533542979264)>, <Thread(tpool_thread_12, started daemon 137533534570176)>, <Thread(tpool_thread_13, started daemon 137533526161088)>, <Thread(tpool_thread_14, started daemon 137533517752000)>, <Thread(tpool_thread_15, started daemon 137533509342912)>, <Thread(tpool_thread_16, started daemon 137533500933824)>, <Thread(tpool_thread_17, started daemon 137533492524736)>, <Thread(tpool_thread_18, started daemon 137533484115648)>, <Thread(tpool_thread_19, started daemon 137533475706560)>] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 07 18:12:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-5e28aa04-101e-4265-9f46-dea0f5422f5c req-1749c03f-257e-4587-b370-e8100bfa83fa tempest-VolumesSnapshotsTestJSON-275046806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-5e28aa04-101e-4265-9f46-dea0f5422f5c req-1749c03f-257e-4587-b370-e8100bfa83fa tempest-VolumesSnapshotsTestJSON-275046806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [req-5e28aa04-101e-4265-9f46-dea0f5422f5c req-1749c03f-257e-4587-b370-e8100bfa83fa tempest-VolumesSnapshotsTestJSON-275046806 None] Creating offline snapshot 5570fcd2-f462-4439-b0d2-993ecdeb78d1 of volume be1badab-b08d-49c3-a4c3-bb2c49629793 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:12:01 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7005b4f5-9d71-4e7e-9ee9-ee3cbaa57d1d]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:12:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-5e28aa04-101e-4265-9f46-dea0f5422f5c req-1749c03f-257e-4587-b370-e8100bfa83fa tempest-VolumesSnapshotsTestJSON-275046806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:01 devstack sudo[100370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793
Sep 07 18:12:01 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:02 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-5e28aa04-101e-4265-9f46-dea0f5422f5c req-1749c03f-257e-4587-b370-e8100bfa83fa tempest-VolumesSnapshotsTestJSON-275046806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793" returned: 0 in 0.522s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-5e28aa04-101e-4265-9f46-dea0f5422f5c req-1749c03f-257e-4587-b370-e8100bfa83fa tempest-VolumesSnapshotsTestJSON-275046806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793.5570fcd2-f462-4439-b0d2-993ecdeb78d1 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:02 devstack sudo[100376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793.5570fcd2-f462-4439-b0d2-993ecdeb78d1 1G
Sep 07 18:12:02 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:03 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-5e28aa04-101e-4265-9f46-dea0f5422f5c req-1749c03f-257e-4587-b370-e8100bfa83fa tempest-VolumesSnapshotsTestJSON-275046806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793.5570fcd2-f462-4439-b0d2-993ecdeb78d1 1G" returned: 0 in 0.771s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-5e28aa04-101e-4265-9f46-dea0f5422f5c req-1749c03f-257e-4587-b370-e8100bfa83fa tempest-VolumesSnapshotsTestJSON-275046806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be1badab-b08d-49c3-a4c3-bb2c49629793 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793.5570fcd2-f462-4439-b0d2-993ecdeb78d1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:03 devstack sudo[100385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be1badab-b08d-49c3-a4c3-bb2c49629793 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793.5570fcd2-f462-4439-b0d2-993ecdeb78d1
Sep 07 18:12:03 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:03 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-5e28aa04-101e-4265-9f46-dea0f5422f5c req-1749c03f-257e-4587-b370-e8100bfa83fa tempest-VolumesSnapshotsTestJSON-275046806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be1badab-b08d-49c3-a4c3-bb2c49629793 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793.5570fcd2-f462-4439-b0d2-993ecdeb78d1" returned: 0 in 0.477s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:03 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [req-5e28aa04-101e-4265-9f46-dea0f5422f5c req-1749c03f-257e-4587-b370-e8100bfa83fa tempest-VolumesSnapshotsTestJSON-275046806 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793.5570fcd2-f462-4439-b0d2-993ecdeb78d1 is being set with open permissions: ugo+rw
Sep 07 18:12:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-5e28aa04-101e-4265-9f46-dea0f5422f5c req-1749c03f-257e-4587-b370-e8100bfa83fa tempest-VolumesSnapshotsTestJSON-275046806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793.5570fcd2-f462-4439-b0d2-993ecdeb78d1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:03 devstack sudo[100393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793.5570fcd2-f462-4439-b0d2-993ecdeb78d1
Sep 07 18:12:03 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:03 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-5e28aa04-101e-4265-9f46-dea0f5422f5c req-1749c03f-257e-4587-b370-e8100bfa83fa tempest-VolumesSnapshotsTestJSON-275046806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793.5570fcd2-f462-4439-b0d2-993ecdeb78d1" returned: 0 in 0.439s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-5e28aa04-101e-4265-9f46-dea0f5422f5c req-1749c03f-257e-4587-b370-e8100bfa83fa tempest-VolumesSnapshotsTestJSON-275046806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-bac6e5bb-f714-42ca-ab6f-a6db98e9a6a3 req-e9a72e8e-15bd-4a3a-ad18-2d5100c4cea3 tempest-TestStampPattern-2010018532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:04 devstack sudo[100404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793.info
Sep 07 18:12:04 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:04 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-5e28aa04-101e-4265-9f46-dea0f5422f5c req-1749c03f-257e-4587-b370-e8100bfa83fa tempest-VolumesSnapshotsTestJSON-275046806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793.info" returned: 0 in 0.319s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:04 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [req-5e28aa04-101e-4265-9f46-dea0f5422f5c req-1749c03f-257e-4587-b370-e8100bfa83fa tempest-VolumesSnapshotsTestJSON-275046806 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793.info is being set with open permissions: ugo+rw
Sep 07 18:12:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-5e28aa04-101e-4265-9f46-dea0f5422f5c req-1749c03f-257e-4587-b370-e8100bfa83fa tempest-VolumesSnapshotsTestJSON-275046806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:04 devstack sudo[100407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793.info
Sep 07 18:12:04 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:04 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-5e28aa04-101e-4265-9f46-dea0f5422f5c req-1749c03f-257e-4587-b370-e8100bfa83fa tempest-VolumesSnapshotsTestJSON-275046806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793.info" returned: 0 in 0.264s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-5e28aa04-101e-4265-9f46-dea0f5422f5c req-1749c03f-257e-4587-b370-e8100bfa83fa tempest-VolumesSnapshotsTestJSON-275046806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.968s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-bac6e5bb-f714-42ca-ab6f-a6db98e9a6a3 req-e9a72e8e-15bd-4a3a-ad18-2d5100c4cea3 tempest-TestStampPattern-2010018532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.582s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-bac6e5bb-f714-42ca-ab6f-a6db98e9a6a3 req-e9a72e8e-15bd-4a3a-ad18-2d5100c4cea3 tempest-TestStampPattern-2010018532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.052s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:04 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-5e28aa04-101e-4265-9f46-dea0f5422f5c req-1749c03f-257e-4587-b370-e8100bfa83fa tempest-VolumesSnapshotsTestJSON-275046806 None] Create snapshot completed successfully
Sep 07 18:12:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-bac6e5bb-f714-42ca-ab6f-a6db98e9a6a3 req-e9a72e8e-15bd-4a3a-ad18-2d5100c4cea3 tempest-TestStampPattern-2010018532 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d', 'name': 'volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eac69ab9-ec56-4a27-8f16-c3353f18065e', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 07 18:12:04 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-bac6e5bb-f714-42ca-ab6f-a6db98e9a6a3 req-e9a72e8e-15bd-4a3a-ad18-2d5100c4cea3 tempest-TestStampPattern-2010018532 None] attachment_update completed successfully.
Sep 07 18:12:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-cb0b1ca1-7fa8-4a41-856b-a079e2526321 req-69f18780-1db0-4a7b-a0c6-6e4d44807f78 tempest-VolumesSnapshotsTestJSON-275046806 None] Acquiring lock "cinder-5570fcd2-f462-4439-b0d2-993ecdeb78d1-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:12:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-cb0b1ca1-7fa8-4a41-856b-a079e2526321 req-69f18780-1db0-4a7b-a0c6-6e4d44807f78 tempest-VolumesSnapshotsTestJSON-275046806 None] Lock "cinder-5570fcd2-f462-4439-b0d2-993ecdeb78d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:12:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-cb0b1ca1-7fa8-4a41-856b-a079e2526321 req-69f18780-1db0-4a7b-a0c6-6e4d44807f78 tempest-VolumesSnapshotsTestJSON-275046806 None] Acquiring lock "cinder-quobyte-be1badab-b08d-49c3-a4c3-bb2c49629793" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:12:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-cb0b1ca1-7fa8-4a41-856b-a079e2526321 req-69f18780-1db0-4a7b-a0c6-6e4d44807f78 tempest-VolumesSnapshotsTestJSON-275046806 None] Lock "cinder-quobyte-be1badab-b08d-49c3-a4c3-bb2c49629793" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:12:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-cb0b1ca1-7fa8-4a41-856b-a079e2526321 req-69f18780-1db0-4a7b-a0c6-6e4d44807f78 tempest-VolumesSnapshotsTestJSON-275046806 None] Acquiring lock "cinder-quobyte-5570fcd2-f462-4439-b0d2-993ecdeb78d1" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:12:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-cb0b1ca1-7fa8-4a41-856b-a079e2526321 req-69f18780-1db0-4a7b-a0c6-6e4d44807f78 tempest-VolumesSnapshotsTestJSON-275046806 None] Lock "cinder-quobyte-5570fcd2-f462-4439-b0d2-993ecdeb78d1" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:12:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [req-cb0b1ca1-7fa8-4a41-856b-a079e2526321 req-69f18780-1db0-4a7b-a0c6-6e4d44807f78 tempest-VolumesSnapshotsTestJSON-275046806 None] Deleting offline snapshot 5570fcd2-f462-4439-b0d2-993ecdeb78d1 of volume be1badab-b08d-49c3-a4c3-bb2c49629793 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:12:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [req-cb0b1ca1-7fa8-4a41-856b-a079e2526321 req-69f18780-1db0-4a7b-a0c6-6e4d44807f78 tempest-VolumesSnapshotsTestJSON-275046806 None] snapshot_file for this snap is: volume-be1badab-b08d-49c3-a4c3-bb2c49629793.5570fcd2-f462-4439-b0d2-993ecdeb78d1 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:12:05 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[15884f6e-0ee6-4c4f-b21d-f7f4866e5cfb]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:12:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-cb0b1ca1-7fa8-4a41-856b-a079e2526321 req-69f18780-1db0-4a7b-a0c6-6e4d44807f78 tempest-VolumesSnapshotsTestJSON-275046806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793.5570fcd2-f462-4439-b0d2-993ecdeb78d1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:06 devstack sudo[100793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793.5570fcd2-f462-4439-b0d2-993ecdeb78d1
Sep 07 18:12:06 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:06 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-cb0b1ca1-7fa8-4a41-856b-a079e2526321 req-69f18780-1db0-4a7b-a0c6-6e4d44807f78 tempest-VolumesSnapshotsTestJSON-275046806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793.5570fcd2-f462-4439-b0d2-993ecdeb78d1" returned: 0 in 0.514s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [req-cb0b1ca1-7fa8-4a41-856b-a079e2526321 req-69f18780-1db0-4a7b-a0c6-6e4d44807f78 tempest-VolumesSnapshotsTestJSON-275046806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be1badab-b08d-49c3-a4c3-bb2c49629793(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:12:06 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b97975-e3d7-4451-b728-0142a76a0589]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:12:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-cb0b1ca1-7fa8-4a41-856b-a079e2526321 req-69f18780-1db0-4a7b-a0c6-6e4d44807f78 tempest-VolumesSnapshotsTestJSON-275046806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:06 devstack sudo[100809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793
Sep 07 18:12:06 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:07 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-cb0b1ca1-7fa8-4a41-856b-a079e2526321 req-69f18780-1db0-4a7b-a0c6-6e4d44807f78 tempest-VolumesSnapshotsTestJSON-275046806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793" returned: 0 in 0.582s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-cb0b1ca1-7fa8-4a41-856b-a079e2526321 req-69f18780-1db0-4a7b-a0c6-6e4d44807f78 tempest-VolumesSnapshotsTestJSON-275046806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793.5570fcd2-f462-4439-b0d2-993ecdeb78d1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:07 devstack sudo[100850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793.5570fcd2-f462-4439-b0d2-993ecdeb78d1
Sep 07 18:12:07 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:07 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-cb0b1ca1-7fa8-4a41-856b-a079e2526321 req-69f18780-1db0-4a7b-a0c6-6e4d44807f78 tempest-VolumesSnapshotsTestJSON-275046806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793.5570fcd2-f462-4439-b0d2-993ecdeb78d1" returned: 0 in 0.527s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-cb0b1ca1-7fa8-4a41-856b-a079e2526321 req-69f18780-1db0-4a7b-a0c6-6e4d44807f78 tempest-VolumesSnapshotsTestJSON-275046806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793.5570fcd2-f462-4439-b0d2-993ecdeb78d1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:07 devstack sudo[100855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793.5570fcd2-f462-4439-b0d2-993ecdeb78d1
Sep 07 18:12:07 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:07 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:12:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Flow 'volume_create_manager' (4457415c-5d44-40a3-9f88-b42fe45bcec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:12:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6460227-e0f6-4503-ba35-7b4f5e20b349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6460227-e0f6-4503-ba35-7b4f5e20b349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1297043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c680e3d-0a06-43f1-93f7-2d92dd34dd4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55dfcffc70e34ecb95f742ef0f78ca68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:12:07Z,use_quota=True,user_id='a922426ef7f149e0b04410c6d5253fd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed02c053-76e8-4a2c-9260-de6ba35d5714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed02c053-76e8-4a2c-9260-de6ba35d5714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1609c61-6f71-49ec-93be-b40161c01270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1609c61-6f71-49ec-93be-b40161c01270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c680e3d-0a06-43f1-93f7-2d92dd34dd4a', 'volume_name': 'volume-5c680e3d-0a06-43f1-93f7-2d92dd34dd4a', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76155cf-1f34-49aa-b299-d5708b4c7532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e76155cf-1f34-49aa-b299-d5708b4c7532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7e5cd9-e6eb-4f20-aa99-ec29ea9e072c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:07 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Volume 5c680e3d-0a06-43f1-93f7-2d92dd34dd4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c680e3d-0a06-43f1-93f7-2d92dd34dd4a', 'volume_size': 1}
Sep 07 18:12:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1297043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c680e3d-0a06-43f1-93f7-2d92dd34dd4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55dfcffc70e34ecb95f742ef0f78ca68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:12:07Z,use_quota=True,user_id='a922426ef7f149e0b04410c6d5253fd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:12:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Creating volume 5c680e3d-0a06-43f1-93f7-2d92dd34dd4a {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:12:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:12:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:12:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:12:07 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:12:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5c680e3d-0a06-43f1-93f7-2d92dd34dd4a 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:07 devstack sudo[100857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5c680e3d-0a06-43f1-93f7-2d92dd34dd4a 1073741824
Sep 07 18:12:07 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:08 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-cb0b1ca1-7fa8-4a41-856b-a079e2526321 req-69f18780-1db0-4a7b-a0c6-6e4d44807f78 tempest-VolumesSnapshotsTestJSON-275046806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793.5570fcd2-f462-4439-b0d2-993ecdeb78d1" returned: 0 in 0.507s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-cb0b1ca1-7fa8-4a41-856b-a079e2526321 req-69f18780-1db0-4a7b-a0c6-6e4d44807f78 tempest-VolumesSnapshotsTestJSON-275046806 None] Lock "cinder-quobyte-5570fcd2-f462-4439-b0d2-993ecdeb78d1" released by "_delete_snapshot" :: held 2.304s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:12:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-cb0b1ca1-7fa8-4a41-856b-a079e2526321 req-69f18780-1db0-4a7b-a0c6-6e4d44807f78 tempest-VolumesSnapshotsTestJSON-275046806 None] Lock "cinder-quobyte-be1badab-b08d-49c3-a4c3-bb2c49629793" released by "delete_snapshot" :: held 2.346s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:12:08 devstack cinder-volume[87269]: DEBUG cinder.quota [req-cb0b1ca1-7fa8-4a41-856b-a079e2526321 req-69f18780-1db0-4a7b-a0c6-6e4d44807f78 tempest-VolumesSnapshotsTestJSON-275046806 None] Created reservations ['a43ae118-c4ce-4090-8b03-a2fb73cf2574', '0e487433-1283-4092-8e7e-513c8ab9397a', '49c7d7eb-3c72-4163-a998-e6b0ba9c8d71', '572fad0b-93f7-4721-87a3-7315c269c19e'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:12:08 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-cb0b1ca1-7fa8-4a41-856b-a079e2526321 req-69f18780-1db0-4a7b-a0c6-6e4d44807f78 tempest-VolumesSnapshotsTestJSON-275046806 None] Delete snapshot completed successfully.
Sep 07 18:12:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-cb0b1ca1-7fa8-4a41-856b-a079e2526321 req-69f18780-1db0-4a7b-a0c6-6e4d44807f78 tempest-VolumesSnapshotsTestJSON-275046806 None] Lock "cinder-5570fcd2-f462-4439-b0d2-993ecdeb78d1-delete_snapshot" released by "delete_snapshot" :: held 2.549s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:12:08 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5c680e3d-0a06-43f1-93f7-2d92dd34dd4a 1073741824" returned: 0 in 0.668s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5c680e3d-0a06-43f1-93f7-2d92dd34dd4a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:08 devstack sudo[100864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5c680e3d-0a06-43f1-93f7-2d92dd34dd4a
Sep 07 18:12:08 devstack sudo[100864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:08 devstack sudo[100864]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5c680e3d-0a06-43f1-93f7-2d92dd34dd4a" returned: 0 in 0.309s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:12:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7e5cd9-e6eb-4f20-aa99-ec29ea9e072c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c680e3d-0a06-43f1-93f7-2d92dd34dd4a', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131af6f4-ea0e-430d-8975-604f9687f352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:08 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Volume volume-5c680e3d-0a06-43f1-93f7-2d92dd34dd4a (5c680e3d-0a06-43f1-93f7-2d92dd34dd4a): created successfully
Sep 07 18:12:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (131af6f4-ea0e-430d-8975-604f9687f352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Flow 'volume_create_manager' (4457415c-5d44-40a3-9f88-b42fe45bcec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:12:08 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0bb31a8e-31f3-421b-99d3-a00205140fd1 tempest-ProjectReaderTests-1433924159 None] Created volume successfully.
Sep 07 18:12:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-c6d5f770-b1ec-4f1c-8017-e2942f7ab6ce req-272cdf83-fb85-414b-94be-7b3d90915ba6 tempest-VolumesSnapshotsTestJSON-275046806 None] Acquiring lock "cinder-be1badab-b08d-49c3-a4c3-bb2c49629793-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:12:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-c6d5f770-b1ec-4f1c-8017-e2942f7ab6ce req-272cdf83-fb85-414b-94be-7b3d90915ba6 tempest-VolumesSnapshotsTestJSON-275046806 None] Lock "cinder-be1badab-b08d-49c3-a4c3-bb2c49629793-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:12:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-c6d5f770-b1ec-4f1c-8017-e2942f7ab6ce req-272cdf83-fb85-414b-94be-7b3d90915ba6 tempest-VolumesSnapshotsTestJSON-275046806 None] Acquiring lock "cinder-quobyte-be1badab-b08d-49c3-a4c3-bb2c49629793" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:12:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-c6d5f770-b1ec-4f1c-8017-e2942f7ab6ce req-272cdf83-fb85-414b-94be-7b3d90915ba6 tempest-VolumesSnapshotsTestJSON-275046806 None] Lock "cinder-quobyte-be1badab-b08d-49c3-a4c3-bb2c49629793" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:12:09 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[414c5a1d-4a39-412a-b83f-b6db4c681c25]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:12:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-c6d5f770-b1ec-4f1c-8017-e2942f7ab6ce req-272cdf83-fb85-414b-94be-7b3d90915ba6 tempest-VolumesSnapshotsTestJSON-275046806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:09 devstack sudo[100879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793
Sep 07 18:12:09 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:09 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-c6d5f770-b1ec-4f1c-8017-e2942f7ab6ce req-272cdf83-fb85-414b-94be-7b3d90915ba6 tempest-VolumesSnapshotsTestJSON-275046806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793" returned: 0 in 0.460s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-c6d5f770-b1ec-4f1c-8017-e2942f7ab6ce req-272cdf83-fb85-414b-94be-7b3d90915ba6 tempest-VolumesSnapshotsTestJSON-275046806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:09 devstack sudo[100884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793
Sep 07 18:12:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1af4cebb-21ac-41a9-93f5-b21d932acc68 tempest-ProjectReaderTests-1433924159 None] Acquiring lock "cinder-5c680e3d-0a06-43f1-93f7-2d92dd34dd4a-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:12:09 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1af4cebb-21ac-41a9-93f5-b21d932acc68 tempest-ProjectReaderTests-1433924159 None] Lock "cinder-5c680e3d-0a06-43f1-93f7-2d92dd34dd4a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:12:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1af4cebb-21ac-41a9-93f5-b21d932acc68 tempest-ProjectReaderTests-1433924159 None] Acquiring lock "cinder-quobyte-5c680e3d-0a06-43f1-93f7-2d92dd34dd4a" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:12:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1af4cebb-21ac-41a9-93f5-b21d932acc68 tempest-ProjectReaderTests-1433924159 None] Lock "cinder-quobyte-5c680e3d-0a06-43f1-93f7-2d92dd34dd4a" acquired by "delete_volume" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:12:10 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ec8382-dee1-4fff-aed6-3200bca2c91e]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:12:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1af4cebb-21ac-41a9-93f5-b21d932acc68 tempest-ProjectReaderTests-1433924159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5c680e3d-0a06-43f1-93f7-2d92dd34dd4a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:10 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-c6d5f770-b1ec-4f1c-8017-e2942f7ab6ce req-272cdf83-fb85-414b-94be-7b3d90915ba6 tempest-VolumesSnapshotsTestJSON-275046806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-be1badab-b08d-49c3-a4c3-bb2c49629793" returned: 0 in 0.337s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:10 devstack sudo[100886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5c680e3d-0a06-43f1-93f7-2d92dd34dd4a
Sep 07 18:12:10 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-c6d5f770-b1ec-4f1c-8017-e2942f7ab6ce req-272cdf83-fb85-414b-94be-7b3d90915ba6 tempest-VolumesSnapshotsTestJSON-275046806 None] Lock "cinder-quobyte-be1badab-b08d-49c3-a4c3-bb2c49629793" released by "delete_volume" :: held 0.913s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:12:10 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-25344371-1022-425a-b3a2-96d1e5ee2396 req-657841d5-169c-4481-9e47-22d13527dad7 tempest-TestStampPattern-2010018532 None] Terminate volume connection completed successfully.
Sep 07 18:12:10 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-25344371-1022-425a-b3a2-96d1e5ee2396 req-657841d5-169c-4481-9e47-22d13527dad7 tempest-TestStampPattern-2010018532 None] Deleting attachment eac69ab9-ec56-4a27-8f16-c3353f18065e. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 07 18:12:10 devstack cinder-volume[87269]: DEBUG cinder.quota [req-c6d5f770-b1ec-4f1c-8017-e2942f7ab6ce req-272cdf83-fb85-414b-94be-7b3d90915ba6 tempest-VolumesSnapshotsTestJSON-275046806 None] Created reservations ['190f2aa1-53dc-43a0-8a24-99b982559353', '1d199e70-075e-43ff-86fb-796f1821dd2a', '605a1e3f-ad2c-41a2-bf24-be79dd77cc01', '25790e4f-03dc-4dfc-8aef-7a98fa52e887'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:12:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-c6d5f770-b1ec-4f1c-8017-e2942f7ab6ce req-272cdf83-fb85-414b-94be-7b3d90915ba6 tempest-VolumesSnapshotsTestJSON-275046806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-c6d5f770-b1ec-4f1c-8017-e2942f7ab6ce req-272cdf83-fb85-414b-94be-7b3d90915ba6 tempest-VolumesSnapshotsTestJSON-275046806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-c6d5f770-b1ec-4f1c-8017-e2942f7ab6ce req-272cdf83-fb85-414b-94be-7b3d90915ba6 tempest-VolumesSnapshotsTestJSON-275046806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:12:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [req-c6d5f770-b1ec-4f1c-8017-e2942f7ab6ce req-272cdf83-fb85-414b-94be-7b3d90915ba6 tempest-VolumesSnapshotsTestJSON-275046806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:12:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-c6d5f770-b1ec-4f1c-8017-e2942f7ab6ce req-272cdf83-fb85-414b-94be-7b3d90915ba6 tempest-VolumesSnapshotsTestJSON-275046806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-c6d5f770-b1ec-4f1c-8017-e2942f7ab6ce req-272cdf83-fb85-414b-94be-7b3d90915ba6 tempest-VolumesSnapshotsTestJSON-275046806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:10 devstack sudo[100917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:12:10 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:10 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1af4cebb-21ac-41a9-93f5-b21d932acc68 tempest-ProjectReaderTests-1433924159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5c680e3d-0a06-43f1-93f7-2d92dd34dd4a" returned: 0 in 0.554s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1af4cebb-21ac-41a9-93f5-b21d932acc68 tempest-ProjectReaderTests-1433924159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5c680e3d-0a06-43f1-93f7-2d92dd34dd4a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:10 devstack sudo[100922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5c680e3d-0a06-43f1-93f7-2d92dd34dd4a
Sep 07 18:12:10 devstack sudo[100922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:10 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [req-c6d5f770-b1ec-4f1c-8017-e2942f7ab6ce req-272cdf83-fb85-414b-94be-7b3d90915ba6 tempest-VolumesSnapshotsTestJSON-275046806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.330s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:10 devstack cinder-volume[87269]: DEBUG cinder.manager [req-c6d5f770-b1ec-4f1c-8017-e2942f7ab6ce req-272cdf83-fb85-414b-94be-7b3d90915ba6 tempest-VolumesSnapshotsTestJSON-275046806 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:12:10 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-c6d5f770-b1ec-4f1c-8017-e2942f7ab6ce req-272cdf83-fb85-414b-94be-7b3d90915ba6 tempest-VolumesSnapshotsTestJSON-275046806 None] Deleted volume successfully.
Sep 07 18:12:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [req-c6d5f770-b1ec-4f1c-8017-e2942f7ab6ce req-272cdf83-fb85-414b-94be-7b3d90915ba6 tempest-VolumesSnapshotsTestJSON-275046806 None] Lock "cinder-be1badab-b08d-49c3-a4c3-bb2c49629793-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:12:10 devstack sudo[100922]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1af4cebb-21ac-41a9-93f5-b21d932acc68 tempest-ProjectReaderTests-1433924159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5c680e3d-0a06-43f1-93f7-2d92dd34dd4a" returned: 0 in 0.336s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1af4cebb-21ac-41a9-93f5-b21d932acc68 tempest-ProjectReaderTests-1433924159 None] Lock "cinder-quobyte-5c680e3d-0a06-43f1-93f7-2d92dd34dd4a" released by "delete_volume" :: held 0.943s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:12:11 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-1af4cebb-21ac-41a9-93f5-b21d932acc68 tempest-ProjectReaderTests-1433924159 None] Created reservations ['b2fe7a4f-cbac-4a66-99e3-887f5aea00f1', '24894781-bd87-4a6c-a56e-4614e0ed211e', 'e4278e57-7e00-4a75-b928-5dbbac86f295', '4f9d5926-41c2-4ed9-b9d1-8073ad105e45'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:12:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1af4cebb-21ac-41a9-93f5-b21d932acc68 tempest-ProjectReaderTests-1433924159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1af4cebb-21ac-41a9-93f5-b21d932acc68 tempest-ProjectReaderTests-1433924159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1af4cebb-21ac-41a9-93f5-b21d932acc68 tempest-ProjectReaderTests-1433924159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:12:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1af4cebb-21ac-41a9-93f5-b21d932acc68 tempest-ProjectReaderTests-1433924159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:12:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1af4cebb-21ac-41a9-93f5-b21d932acc68 tempest-ProjectReaderTests-1433924159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1af4cebb-21ac-41a9-93f5-b21d932acc68 tempest-ProjectReaderTests-1433924159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:11 devstack sudo[100926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:12:11 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-47192586-117f-4ee1-9609-2b8a402d79d1 tempest-TestStampPattern-2010018532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-47192586-117f-4ee1-9609-2b8a402d79d1 tempest-TestStampPattern-2010018532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-47192586-117f-4ee1-9609-2b8a402d79d1 tempest-TestStampPattern-2010018532 None] Creating offline snapshot b7a87e89-3699-469e-a241-236cac0661f9 of volume 00f6df7a-566d-4d64-905f-5c33fc65d3f6 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:12:11 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d28ec9-bf6f-42de-8570-e9a2d797ce34]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:12:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-47192586-117f-4ee1-9609-2b8a402d79d1 tempest-TestStampPattern-2010018532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:11 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1af4cebb-21ac-41a9-93f5-b21d932acc68 tempest-ProjectReaderTests-1433924159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.309s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:11 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-1af4cebb-21ac-41a9-93f5-b21d932acc68 tempest-ProjectReaderTests-1433924159 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:12:11 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-1af4cebb-21ac-41a9-93f5-b21d932acc68 tempest-ProjectReaderTests-1433924159 None] Deleted volume successfully.
Sep 07 18:12:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1af4cebb-21ac-41a9-93f5-b21d932acc68 tempest-ProjectReaderTests-1433924159 None] Lock "cinder-5c680e3d-0a06-43f1-93f7-2d92dd34dd4a-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:12:11 devstack sudo[100928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6
Sep 07 18:12:11 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:11 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-47192586-117f-4ee1-9609-2b8a402d79d1 tempest-TestStampPattern-2010018532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6" returned: 0 in 0.450s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-47192586-117f-4ee1-9609-2b8a402d79d1 tempest-TestStampPattern-2010018532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.b7a87e89-3699-469e-a241-236cac0661f9 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:11 devstack sudo[100934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.b7a87e89-3699-469e-a241-236cac0661f9 1G
Sep 07 18:12:11 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:12 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-47192586-117f-4ee1-9609-2b8a402d79d1 tempest-TestStampPattern-2010018532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.b7a87e89-3699-469e-a241-236cac0661f9 1G" returned: 0 in 0.548s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-47192586-117f-4ee1-9609-2b8a402d79d1 tempest-TestStampPattern-2010018532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.b7a87e89-3699-469e-a241-236cac0661f9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:12 devstack sudo[100941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.b7a87e89-3699-469e-a241-236cac0661f9
Sep 07 18:12:12 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:12 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-47192586-117f-4ee1-9609-2b8a402d79d1 tempest-TestStampPattern-2010018532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.b7a87e89-3699-469e-a241-236cac0661f9" returned: 0 in 0.488s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:12 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-47192586-117f-4ee1-9609-2b8a402d79d1 tempest-TestStampPattern-2010018532 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.b7a87e89-3699-469e-a241-236cac0661f9 is being set with open permissions: ugo+rw
Sep 07 18:12:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-47192586-117f-4ee1-9609-2b8a402d79d1 tempest-TestStampPattern-2010018532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.b7a87e89-3699-469e-a241-236cac0661f9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:12 devstack sudo[100947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.b7a87e89-3699-469e-a241-236cac0661f9
Sep 07 18:12:12 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:12 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:12:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Flow 'volume_create_manager' (06ef50ab-548e-4a0d-aaa5-bf96018d270d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:12:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad01eab-bf07-4fad-86b3-779c37fa5396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cad01eab-bf07-4fad-86b3-779c37fa5396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1703769965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15c7f04-d3e7-420d-bbce-3c998e9d6c7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55dfcffc70e34ecb95f742ef0f78ca68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:12:13Z,use_quota=True,user_id='a922426ef7f149e0b04410c6d5253fd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a8058f8-9295-4a4f-ab92-e092d11fa976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a8058f8-9295-4a4f-ab92-e092d11fa976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe1e15b-f785-4526-9a08-47e70af4e823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe1e15b-f785-4526-9a08-47e70af4e823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b15c7f04-d3e7-420d-bbce-3c998e9d6c7a', 'volume_name': 'volume-b15c7f04-d3e7-420d-bbce-3c998e9d6c7a', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48682190-c5a3-4ca8-94c0-d3b3e3c14b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48682190-c5a3-4ca8-94c0-d3b3e3c14b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b4268ff-4275-4864-b624-63dffdfae0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:13 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Volume b15c7f04-d3e7-420d-bbce-3c998e9d6c7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b15c7f04-d3e7-420d-bbce-3c998e9d6c7a', 'volume_size': 1}
Sep 07 18:12:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:13 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-47192586-117f-4ee1-9609-2b8a402d79d1 tempest-TestStampPattern-2010018532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.b7a87e89-3699-469e-a241-236cac0661f9" returned: 0 in 0.402s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-47192586-117f-4ee1-9609-2b8a402d79d1 tempest-TestStampPattern-2010018532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:13 devstack sudo[100950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.info
Sep 07 18:12:13 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:13 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:12:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Flow 'volume_create_manager' (a511303b-7920-4ac7-b0da-92723ca39b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:12:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c425833-3105-403e-a9ae-1f5db80de523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c425833-3105-403e-a9ae-1f5db80de523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-57742372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fcc75ec-20cd-47e0-8277-50ededb3dd29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad384f92ace14672876b90d57726e369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:12:13Z,use_quota=True,user_id='890cf4c114614387b43ae544cd2973ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87dbbb07-e70d-45dd-ba1c-5f5a95627317),volume_type_id=87dbbb07-e70d-45dd-ba1c-5f5a95627317)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa39ce5c-5cf2-4342-a056-f3963279486f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa39ce5c-5cf2-4342-a056-f3963279486f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d76894e-1f15-4448-94f7-6cd8df758ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d76894e-1f15-4448-94f7-6cd8df758ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fcc75ec-20cd-47e0-8277-50ededb3dd29', 'volume_name': 'volume-0fcc75ec-20cd-47e0-8277-50ededb3dd29', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43dc99c6-572a-4819-bb27-75bef1819806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43dc99c6-572a-4819-bb27-75bef1819806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a89098e-a456-4fa1-8d25-b40c843a0fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:13 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Volume 0fcc75ec-20cd-47e0-8277-50ededb3dd29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fcc75ec-20cd-47e0-8277-50ededb3dd29', 'volume_size': 1}
Sep 07 18:12:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:13 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-47192586-117f-4ee1-9609-2b8a402d79d1 tempest-TestStampPattern-2010018532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.info" returned: 0 in 0.468s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:13 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-47192586-117f-4ee1-9609-2b8a402d79d1 tempest-TestStampPattern-2010018532 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.info is being set with open permissions: ugo+rw
Sep 07 18:12:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-47192586-117f-4ee1-9609-2b8a402d79d1 tempest-TestStampPattern-2010018532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:13 devstack sudo[100953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.info
Sep 07 18:12:13 devstack sudo[100953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:14 devstack sudo[100953]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-47192586-117f-4ee1-9609-2b8a402d79d1 tempest-TestStampPattern-2010018532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.info" returned: 0 in 0.328s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-47192586-117f-4ee1-9609-2b8a402d79d1 tempest-TestStampPattern-2010018532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.805s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.004s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1703769965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15c7f04-d3e7-420d-bbce-3c998e9d6c7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55dfcffc70e34ecb95f742ef0f78ca68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:12:13Z,use_quota=True,user_id='a922426ef7f149e0b04410c6d5253fd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:12:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Creating volume b15c7f04-d3e7-420d-bbce-3c998e9d6c7a {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:12:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:12:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:12:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:12:14 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:12:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b15c7f04-d3e7-420d-bbce-3c998e9d6c7a 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:14 devstack sudo[100956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b15c7f04-d3e7-420d-bbce-3c998e9d6c7a 1073741824
Sep 07 18:12:14 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:14 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-47192586-117f-4ee1-9609-2b8a402d79d1 tempest-TestStampPattern-2010018532 None] Create snapshot completed successfully
Sep 07 18:12:14 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:12:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Flow 'volume_create_manager' (0cc3e4b2-b129-46f8-a94a-1fcb6100d1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:12:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33e98cc9-53a0-4a0e-acac-fe47688abbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33e98cc9-53a0-4a0e-acac-fe47688abbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1909062153',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d56b385-5c97-43ea-b97f-78df27d88947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad384f92ace14672876b90d57726e369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:12:14Z,use_quota=True,user_id='890cf4c114614387b43ae544cd2973ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(031deb02-5a97-42d3-89e3-ea0454af611a),volume_type_id=031deb02-5a97-42d3-89e3-ea0454af611a)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c00acdd-9426-49b7-a855-9297cd523201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c00acdd-9426-49b7-a855-9297cd523201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e1bb592-c49b-498f-ae10-73dfc36152b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e1bb592-c49b-498f-ae10-73dfc36152b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d56b385-5c97-43ea-b97f-78df27d88947', 'volume_name': 'volume-8d56b385-5c97-43ea-b97f-78df27d88947', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8f9e21-83aa-4771-bf5b-eac97dc84de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca8f9e21-83aa-4771-bf5b-eac97dc84de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e365b47-f093-4dc8-8017-34e953a52e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:14 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Volume 8d56b385-5c97-43ea-b97f-78df27d88947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d56b385-5c97-43ea-b97f-78df27d88947', 'volume_size': 1}
Sep 07 18:12:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:14 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b15c7f04-d3e7-420d-bbce-3c998e9d6c7a 1073741824" returned: 0 in 0.617s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b15c7f04-d3e7-420d-bbce-3c998e9d6c7a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:14 devstack sudo[100962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b15c7f04-d3e7-420d-bbce-3c998e9d6c7a
Sep 07 18:12:14 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:15 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b15c7f04-d3e7-420d-bbce-3c998e9d6c7a" returned: 0 in 0.352s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.470s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-57742372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fcc75ec-20cd-47e0-8277-50ededb3dd29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad384f92ace14672876b90d57726e369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:12:13Z,use_quota=True,user_id='890cf4c114614387b43ae544cd2973ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87dbbb07-e70d-45dd-ba1c-5f5a95627317),volume_type_id=87dbbb07-e70d-45dd-ba1c-5f5a95627317)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Creating volume 0fcc75ec-20cd-47e0-8277-50ededb3dd29 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:12:15 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-0fcc75ec-20cd-47e0-8277-50ededb3dd29 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:15 devstack sudo[100965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-0fcc75ec-20cd-47e0-8277-50ededb3dd29 1073741824
Sep 07 18:12:15 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b4268ff-4275-4864-b624-63dffdfae0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b15c7f04-d3e7-420d-bbce-3c998e9d6c7a', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5bbe3ac-a82e-4251-9149-6728d1501541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:15 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Volume volume-b15c7f04-d3e7-420d-bbce-3c998e9d6c7a (b15c7f04-d3e7-420d-bbce-3c998e9d6c7a): created successfully
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5bbe3ac-a82e-4251-9149-6728d1501541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Flow 'volume_create_manager' (06ef50ab-548e-4a0d-aaa5-bf96018d270d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Flow 'volume_create_manager' (a47ceeb4-c3ad-42c4-8f59-9bdab9c02e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c44d07-4fef-4c53-ab63-0aebe9f8e843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c44d07-4fef-4c53-ab63-0aebe9f8e843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1163227737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d785ce-cdd7-4aea-a838-2baad8895863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad384f92ace14672876b90d57726e369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:12:15Z,use_quota=True,user_id='890cf4c114614387b43ae544cd2973ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0001d76-2978-49c0-b241-9bf5e627c025),volume_type_id=a0001d76-2978-49c0-b241-9bf5e627c025)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af00d9cd-cc34-4578-8987-505a480f263f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af00d9cd-cc34-4578-8987-505a480f263f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8d7fd7-ac0a-44a9-9a90-faca1f75d1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG cinder.image.glance [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Creating Keystone auth plugin from conf {{(pid=87269) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 07 18:12:15 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-67968812-cea1-4e72-a497-b61aa561eff5 tempest-ProjectReaderTests-1433924159 None] Created volume successfully.
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8d7fd7-ac0a-44a9-9a90-faca1f75d1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '28d785ce-cdd7-4aea-a838-2baad8895863', 'volume_name': 'volume-28d785ce-cdd7-4aea-a838-2baad8895863', 'volume_size': 1, 'image_id': 'be9e568f-fcff-41e9-bcf5-15b53be52299', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be9e568f-fcff-41e9-bcf5-15b53be52299', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1030789315', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad384f92ace14672876b90d57726e369', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be9e568f-fcff-41e9-bcf5-15b53be52299', 'created_at': datetime.datetime(2026, 9, 7, 16, 12, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 16, 12, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be9e568f-fcff-41e9-bcf5-15b53be52299/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d160b8ea510>}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70c05b6a-1b39-4d3f-95a1-71682e27f4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70c05b6a-1b39-4d3f-95a1-71682e27f4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76927031-9fda-4ad5-a6c2-7bad5344c84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:15 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Volume 28d785ce-cdd7-4aea-a838-2baad8895863: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-28d785ce-cdd7-4aea-a838-2baad8895863', 'volume_size': 1, 'image_id': 'be9e568f-fcff-41e9-bcf5-15b53be52299', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be9e568f-fcff-41e9-bcf5-15b53be52299', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1030789315', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad384f92ace14672876b90d57726e369', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be9e568f-fcff-41e9-bcf5-15b53be52299', 'created_at': datetime.datetime(2026, 9, 7, 16, 12, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 16, 12, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be9e568f-fcff-41e9-bcf5-15b53be52299/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d160b8ea510>}
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Trying to clone 28d785ce-cdd7-4aea-a838-2baad8895863 from image be9e568f-fcff-41e9-bcf5-15b53be52299 at location (None, [{'url': 'file:///opt/stack/data/glance/images/be9e568f-fcff-41e9-bcf5-15b53be52299', 'metadata': {}}]). {{(pid=87269) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 07 18:12:15 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-0fcc75ec-20cd-47e0-8277-50ededb3dd29 1073741824" returned: 0 in 0.604s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-0fcc75ec-20cd-47e0-8277-50ededb3dd29 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:15 devstack sudo[100971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-0fcc75ec-20cd-47e0-8277-50ededb3dd29
Sep 07 18:12:15 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-fe6c41e7-4ccb-4517-beeb-160cd974ea17 tempest-ProjectReaderTests-1433924159 None] Acquiring lock "cinder-b15c7f04-d3e7-420d-bbce-3c998e9d6c7a-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:12:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-fe6c41e7-4ccb-4517-beeb-160cd974ea17 tempest-ProjectReaderTests-1433924159 None] Lock "cinder-b15c7f04-d3e7-420d-bbce-3c998e9d6c7a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:12:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-fe6c41e7-4ccb-4517-beeb-160cd974ea17 tempest-ProjectReaderTests-1433924159 None] Acquiring lock "cinder-quobyte-b15c7f04-d3e7-420d-bbce-3c998e9d6c7a" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:12:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-fe6c41e7-4ccb-4517-beeb-160cd974ea17 tempest-ProjectReaderTests-1433924159 None] Lock "cinder-quobyte-b15c7f04-d3e7-420d-bbce-3c998e9d6c7a" acquired by "delete_volume" :: waited 0.032s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:12:16 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-0fcc75ec-20cd-47e0-8277-50ededb3dd29" returned: 0 in 0.469s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:12:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:16 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58c4e5f-bb61-4e11-9829-84e743eced4e]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:12:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.027s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1909062153',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d56b385-5c97-43ea-b97f-78df27d88947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad384f92ace14672876b90d57726e369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:12:14Z,use_quota=True,user_id='890cf4c114614387b43ae544cd2973ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(031deb02-5a97-42d3-89e3-ea0454af611a),volume_type_id=031deb02-5a97-42d3-89e3-ea0454af611a)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:12:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Creating volume 8d56b385-5c97-43ea-b97f-78df27d88947 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:12:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:12:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:12:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:12:16 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:12:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8d56b385-5c97-43ea-b97f-78df27d88947 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fe6c41e7-4ccb-4517-beeb-160cd974ea17 tempest-ProjectReaderTests-1433924159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b15c7f04-d3e7-420d-bbce-3c998e9d6c7a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a89098e-a456-4fa1-8d25-b40c843a0fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fcc75ec-20cd-47e0-8277-50ededb3dd29', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7f1557-f5c3-4683-ae2e-0b092dd428a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:16 devstack sudo[100975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8d56b385-5c97-43ea-b97f-78df27d88947 1073741824
Sep 07 18:12:16 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:16 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Volume volume-0fcc75ec-20cd-47e0-8277-50ededb3dd29 (0fcc75ec-20cd-47e0-8277-50ededb3dd29): created successfully
Sep 07 18:12:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7f1557-f5c3-4683-ae2e-0b092dd428a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Flow 'volume_create_manager' (a511303b-7920-4ac7-b0da-92723ca39b26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:12:16 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-c0871f09-80ad-415f-83dc-b120e05fe200 tempest-TestInstancesWithCinderVolumes-601362612 None] Created volume successfully.
Sep 07 18:12:16 devstack sudo[100976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b15c7f04-d3e7-420d-bbce-3c998e9d6c7a
Sep 07 18:12:16 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:16 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fe6c41e7-4ccb-4517-beeb-160cd974ea17 tempest-ProjectReaderTests-1433924159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b15c7f04-d3e7-420d-bbce-3c998e9d6c7a" returned: 0 in 0.507s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fe6c41e7-4ccb-4517-beeb-160cd974ea17 tempest-ProjectReaderTests-1433924159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b15c7f04-d3e7-420d-bbce-3c998e9d6c7a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:16 devstack sudo[100992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b15c7f04-d3e7-420d-bbce-3c998e9d6c7a
Sep 07 18:12:16 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:17 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8d56b385-5c97-43ea-b97f-78df27d88947 1073741824" returned: 0 in 0.744s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8d56b385-5c97-43ea-b97f-78df27d88947 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:17 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:17 devstack sudo[101000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8d56b385-5c97-43ea-b97f-78df27d88947
Sep 07 18:12:17 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fe6c41e7-4ccb-4517-beeb-160cd974ea17 tempest-ProjectReaderTests-1433924159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b15c7f04-d3e7-420d-bbce-3c998e9d6c7a" returned: 0 in 0.341s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-fe6c41e7-4ccb-4517-beeb-160cd974ea17 tempest-ProjectReaderTests-1433924159 None] Lock "cinder-quobyte-b15c7f04-d3e7-420d-bbce-3c998e9d6c7a" released by "delete_volume" :: held 0.947s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:12:17 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-fe6c41e7-4ccb-4517-beeb-160cd974ea17 tempest-ProjectReaderTests-1433924159 None] Created reservations ['718a1a69-9fef-47d0-84bc-def836118afe', 'ea8cd2b5-f5cf-4869-9cf0-af93452da988', 'a9ce01e4-9664-4f3b-b95f-d1d34ea9237d', '084f3bd0-0422-4f9f-bbf9-62bbfbc49813'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:12:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fe6c41e7-4ccb-4517-beeb-160cd974ea17 tempest-ProjectReaderTests-1433924159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fe6c41e7-4ccb-4517-beeb-160cd974ea17 tempest-ProjectReaderTests-1433924159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fe6c41e7-4ccb-4517-beeb-160cd974ea17 tempest-ProjectReaderTests-1433924159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:12:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fe6c41e7-4ccb-4517-beeb-160cd974ea17 tempest-ProjectReaderTests-1433924159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:12:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fe6c41e7-4ccb-4517-beeb-160cd974ea17 tempest-ProjectReaderTests-1433924159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fe6c41e7-4ccb-4517-beeb-160cd974ea17 tempest-ProjectReaderTests-1433924159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:17 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8d56b385-5c97-43ea-b97f-78df27d88947" returned: 0 in 0.394s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:12:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:17 devstack sudo[101010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:12:17 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e365b47-f093-4dc8-8017-34e953a52e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d56b385-5c97-43ea-b97f-78df27d88947', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a97f911a-0bab-45f8-a7af-931d158e7e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:17 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Volume volume-8d56b385-5c97-43ea-b97f-78df27d88947 (8d56b385-5c97-43ea-b97f-78df27d88947): created successfully
Sep 07 18:12:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a97f911a-0bab-45f8-a7af-931d158e7e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Flow 'volume_create_manager' (0cc3e4b2-b129-46f8-a94a-1fcb6100d1e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:12:17 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-692e3d49-c0cc-49df-93e6-1f756d5db963 tempest-TestInstancesWithCinderVolumes-601362612 None] Created volume successfully.
Sep 07 18:12:17 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fe6c41e7-4ccb-4517-beeb-160cd974ea17 tempest-ProjectReaderTests-1433924159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.279s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:17 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-fe6c41e7-4ccb-4517-beeb-160cd974ea17 tempest-ProjectReaderTests-1433924159 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:12:17 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-fe6c41e7-4ccb-4517-beeb-160cd974ea17 tempest-ProjectReaderTests-1433924159 None] Deleted volume successfully.
Sep 07 18:12:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-fe6c41e7-4ccb-4517-beeb-160cd974ea17 tempest-ProjectReaderTests-1433924159 None] Lock "cinder-b15c7f04-d3e7-420d-bbce-3c998e9d6c7a-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:12:19 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:12:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Flow 'volume_create_manager' (ee5256a1-abed-4cb8-bf1c-01dcc7579ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:12:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5db8e3ad-a152-4d0d-9ebf-5a8dd6afb122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5db8e3ad-a152-4d0d-9ebf-5a8dd6afb122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-433556280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1417e0ac-77fa-4955-a95b-886c3ff1105e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55dfcffc70e34ecb95f742ef0f78ca68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:12:19Z,use_quota=True,user_id='a922426ef7f149e0b04410c6d5253fd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfab3030-c91f-4e32-ae20-9e09f60fa4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfab3030-c91f-4e32-ae20-9e09f60fa4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b5ad97-e13d-4ff0-80d9-a340ba75cca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b5ad97-e13d-4ff0-80d9-a340ba75cca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1417e0ac-77fa-4955-a95b-886c3ff1105e', 'volume_name': 'volume-1417e0ac-77fa-4955-a95b-886c3ff1105e', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f3f952-c792-487c-a3a9-9e680dd96098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f3f952-c792-487c-a3a9-9e680dd96098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d338bf70-ed71-4cff-b6a9-85ad46f60d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:19 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Volume 1417e0ac-77fa-4955-a95b-886c3ff1105e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1417e0ac-77fa-4955-a95b-886c3ff1105e', 'volume_size': 1}
Sep 07 18:12:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-433556280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1417e0ac-77fa-4955-a95b-886c3ff1105e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55dfcffc70e34ecb95f742ef0f78ca68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:12:19Z,use_quota=True,user_id='a922426ef7f149e0b04410c6d5253fd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:12:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Creating volume 1417e0ac-77fa-4955-a95b-886c3ff1105e {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:12:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:12:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:12:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:12:19 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:12:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1417e0ac-77fa-4955-a95b-886c3ff1105e 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:19 devstack sudo[101020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1417e0ac-77fa-4955-a95b-886c3ff1105e 1073741824
Sep 07 18:12:19 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:19 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1417e0ac-77fa-4955-a95b-886c3ff1105e 1073741824" returned: 0 in 0.576s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1417e0ac-77fa-4955-a95b-886c3ff1105e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:19 devstack sudo[101026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1417e0ac-77fa-4955-a95b-886c3ff1105e
Sep 07 18:12:19 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:20 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1417e0ac-77fa-4955-a95b-886c3ff1105e" returned: 0 in 0.305s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:12:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d338bf70-ed71-4cff-b6a9-85ad46f60d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1417e0ac-77fa-4955-a95b-886c3ff1105e', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e1b3f8-f10c-4ee5-b873-a500878397ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:20 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Volume volume-1417e0ac-77fa-4955-a95b-886c3ff1105e (1417e0ac-77fa-4955-a95b-886c3ff1105e): created successfully
Sep 07 18:12:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e1b3f8-f10c-4ee5-b873-a500878397ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Flow 'volume_create_manager' (ee5256a1-abed-4cb8-bf1c-01dcc7579ae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:12:20 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2c382c05-5132-4971-9b26-d3be16ddf92e tempest-ProjectReaderTests-1433924159 None] Created volume successfully.
Sep 07 18:12:20 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_be9e568f-fcff-41e9-bcf5-15b53be52299_pr8jjh4bdevstack@QuobyteHD, size 20.69 MB, duration 5.19 sec {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 07 18:12:20 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Image download 20.69 MB at 3.99 MB/s
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[51df9066-ad81-4895-b432-1f4e40000ceb]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be9e568f-fcff-41e9-bcf5-15b53be52299_pr8jjh4bdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3d25e563-160e-41d9-b6b6-662603d812c1 tempest-BackendsCapabilitiesAdminTestsJSON-90551729 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5530242919922, 'free_capacity_gb': 1773.5530242919922, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87269) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fd92a0c0-3645-43ee-a084-0287983f6c92 tempest-BackendsCapabilitiesAdminTestsJSON-90551729 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5530242919922, 'free_capacity_gb': 1773.5530242919922, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87269) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 07 18:12:21 devstack sudo[101029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be9e568f-fcff-41e9-bcf5-15b53be52299_pr8jjh4bdevstack@QuobyteHD
Sep 07 18:12:21 devstack sudo[101029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-96e27368-4027-4989-9af3-2d7808c0a7bd tempest-ProjectReaderTests-1433924159 None] Acquiring lock "cinder-1417e0ac-77fa-4955-a95b-886c3ff1105e-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:12:21 devstack sudo[101029]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be9e568f-fcff-41e9-bcf5-15b53be52299_pr8jjh4bdevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Temporary image be9e568f-fcff-41e9-bcf5-15b53be52299 is fetched for user 890cf4c114614387b43ae544cd2973ba. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-96e27368-4027-4989-9af3-2d7808c0a7bd tempest-ProjectReaderTests-1433924159 None] Lock "cinder-1417e0ac-77fa-4955-a95b-886c3ff1105e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-96e27368-4027-4989-9af3-2d7808c0a7bd tempest-ProjectReaderTests-1433924159 None] Acquiring lock "cinder-quobyte-1417e0ac-77fa-4955-a95b-886c3ff1105e" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-96e27368-4027-4989-9af3-2d7808c0a7bd tempest-ProjectReaderTests-1433924159 None] Lock "cinder-quobyte-1417e0ac-77fa-4955-a95b-886c3ff1105e" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[57faa0ec-9c30-400d-bebc-46b3db706683]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be9e568f-fcff-41e9-bcf5-15b53be52299_pr8jjh4bdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1727425-eb69-4b16-a7e8-9a524164d453]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-96e27368-4027-4989-9af3-2d7808c0a7bd tempest-ProjectReaderTests-1433924159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1417e0ac-77fa-4955-a95b-886c3ff1105e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:21 devstack sudo[101035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be9e568f-fcff-41e9-bcf5-15b53be52299_pr8jjh4bdevstack@QuobyteHD
Sep 07 18:12:21 devstack sudo[101035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:21 devstack sudo[101036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1417e0ac-77fa-4955-a95b-886c3ff1105e
Sep 07 18:12:21 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:21 devstack sudo[101035]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be9e568f-fcff-41e9-bcf5-15b53be52299_pr8jjh4bdevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1163227737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d785ce-cdd7-4aea-a838-2baad8895863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad384f92ace14672876b90d57726e369',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:12:15Z,use_quota=True,user_id='890cf4c114614387b43ae544cd2973ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0001d76-2978-49c0-b241-9bf5e627c025),volume_type_id=a0001d76-2978-49c0-b241-9bf5e627c025)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Creating volume 28d785ce-cdd7-4aea-a838-2baad8895863 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:12:21 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28d785ce-cdd7-4aea-a838-2baad8895863 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:21 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-96e27368-4027-4989-9af3-2d7808c0a7bd tempest-ProjectReaderTests-1433924159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1417e0ac-77fa-4955-a95b-886c3ff1105e" returned: 0 in 0.418s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:21 devstack sudo[101045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28d785ce-cdd7-4aea-a838-2baad8895863 1073741824
Sep 07 18:12:21 devstack sudo[101045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-96e27368-4027-4989-9af3-2d7808c0a7bd tempest-ProjectReaderTests-1433924159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1417e0ac-77fa-4955-a95b-886c3ff1105e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:22 devstack sudo[101047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1417e0ac-77fa-4955-a95b-886c3ff1105e
Sep 07 18:12:22 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:22 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-96e27368-4027-4989-9af3-2d7808c0a7bd tempest-ProjectReaderTests-1433924159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1417e0ac-77fa-4955-a95b-886c3ff1105e" returned: 0 in 0.290s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-96e27368-4027-4989-9af3-2d7808c0a7bd tempest-ProjectReaderTests-1433924159 None] Lock "cinder-quobyte-1417e0ac-77fa-4955-a95b-886c3ff1105e" released by "delete_volume" :: held 0.763s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:12:22 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-96e27368-4027-4989-9af3-2d7808c0a7bd tempest-ProjectReaderTests-1433924159 None] Created reservations ['83869a42-ed34-44be-a426-6d405a5d1e76', 'bd25a017-8d44-428b-a264-7bff88cf8a09', 'fae9e403-53dd-4945-a553-106a68df170c', '4728809c-cfb1-46a4-821e-3cad691a2f6b'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:12:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-96e27368-4027-4989-9af3-2d7808c0a7bd tempest-ProjectReaderTests-1433924159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-96e27368-4027-4989-9af3-2d7808c0a7bd tempest-ProjectReaderTests-1433924159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-96e27368-4027-4989-9af3-2d7808c0a7bd tempest-ProjectReaderTests-1433924159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:12:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-96e27368-4027-4989-9af3-2d7808c0a7bd tempest-ProjectReaderTests-1433924159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:12:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-96e27368-4027-4989-9af3-2d7808c0a7bd tempest-ProjectReaderTests-1433924159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-96e27368-4027-4989-9af3-2d7808c0a7bd tempest-ProjectReaderTests-1433924159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:22 devstack sudo[101054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:12:22 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:22 devstack sudo[101045]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28d785ce-cdd7-4aea-a838-2baad8895863 1073741824" returned: 0 in 0.577s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28d785ce-cdd7-4aea-a838-2baad8895863 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:22 devstack sudo[101056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28d785ce-cdd7-4aea-a838-2baad8895863
Sep 07 18:12:22 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:22 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-96e27368-4027-4989-9af3-2d7808c0a7bd tempest-ProjectReaderTests-1433924159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.432s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:22 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-96e27368-4027-4989-9af3-2d7808c0a7bd tempest-ProjectReaderTests-1433924159 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:12:22 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-96e27368-4027-4989-9af3-2d7808c0a7bd tempest-ProjectReaderTests-1433924159 None] Deleted volume successfully.
Sep 07 18:12:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-96e27368-4027-4989-9af3-2d7808c0a7bd tempest-ProjectReaderTests-1433924159 None] Lock "cinder-1417e0ac-77fa-4955-a95b-886c3ff1105e-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:12:23 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28d785ce-cdd7-4aea-a838-2baad8895863" returned: 0 in 0.442s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Attempting download of be9e568f-fcff-41e9-bcf5-15b53be52299 ((None, [{'url': 'file:///opt/stack/data/glance/images/be9e568f-fcff-41e9-bcf5-15b53be52299', 'metadata': {}}])) to volume 28d785ce-cdd7-4aea-a838-2baad8895863. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6168f698-2b91-41a7-9b26-9c82e2fff4ca]: (4, 'raw') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be9e568f-fcff-41e9-bcf5-15b53be52299_gd19s178 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:12:23 devstack sudo[101061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be9e568f-fcff-41e9-bcf5-15b53be52299_gd19s178
Sep 07 18:12:23 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Flow 'volume_create_manager' (f905cb8c-cc0c-4438-805b-12d03db66210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d652ad7-ae47-4deb-8e19-acafd3edc583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d652ad7-ae47-4deb-8e19-acafd3edc583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1593019711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7fab6c5-326c-4600-977c-4affec6c398b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4630a1dd241747cc9665572ded1c9754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b7a87e89-3699-469e-a241-236cac0661f9,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:12:23Z,use_quota=True,user_id='4e8d5be4564a40768fb1aff20d8aef5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ba2786-db7d-43ca-96dd-42172943d195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ba2786-db7d-43ca-96dd-42172943d195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4309e2-c47f-4300-bfdb-e7f4787b51fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a4309e2-c47f-4300-bfdb-e7f4787b51fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b7fab6c5-326c-4600-977c-4affec6c398b', 'volume_name': 'volume-b7fab6c5-326c-4600-977c-4affec6c398b', 'volume_size': 1, 'snapshot_id': 'b7a87e89-3699-469e-a241-236cac0661f9'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9098a4d-cd3b-49d6-967f-8eb625015164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9098a4d-cd3b-49d6-967f-8eb625015164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2c5a7a7-b981-45c5-9933-e15246c3c08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:23 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Volume b7fab6c5-326c-4600-977c-4affec6c398b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b7fab6c5-326c-4600-977c-4affec6c398b', 'volume_size': 1, 'snapshot_id': 'b7a87e89-3699-469e-a241-236cac0661f9'}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Acquiring lock "cinder-quobyte-b7a87e89-3699-469e-a241-236cac0661f9-b7fab6c5-326c-4600-977c-4affec6c398b" by "_create_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Lock "cinder-quobyte-b7a87e89-3699-469e-a241-236cac0661f9-b7fab6c5-326c-4600-977c-4affec6c398b" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Creating volume b7fab6c5-326c-4600-977c-4affec6c398b from snapshot b7a87e89-3699-469e-a241-236cac0661f9 {{(pid=87269) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Acquiring lock "cinder-quobyte-b7fab6c5-326c-4600-977c-4affec6c398b" by "_copy_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Flow 'volume_create_manager' (4959b624-4c73-4b95-a798-252c9296392b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee8ae5c7-e42d-48c7-b33d-30cab8664022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Lock "cinder-quobyte-b7fab6c5-326c-4600-977c-4affec6c398b" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] snapshot: b7a87e89-3699-469e-a241-236cac0661f9, volume: b7fab6c5-326c-4600-977c-4affec6c398b,  {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 07 18:12:23 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be9e568f-fcff-41e9-bcf5-15b53be52299_gd19s178" returned: 0 in 0.449s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be9e568f-fcff-41e9-bcf5-15b53be52299_gd19s178 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee8ae5c7-e42d-48c7-b33d-30cab8664022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1081704063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66059b3d-c574-40b6-a301-a173f7d24c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55dfcffc70e34ecb95f742ef0f78ca68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:12:23Z,use_quota=True,user_id='a922426ef7f149e0b04410c6d5253fd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47c6c05-0a82-4d7d-99a4-59969dd5c393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c47c6c05-0a82-4d7d-99a4-59969dd5c393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10dd518a-8ba2-4d35-988f-a61ebd84a850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10dd518a-8ba2-4d35-988f-a61ebd84a850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66059b3d-c574-40b6-a301-a173f7d24c39', 'volume_name': 'volume-66059b3d-c574-40b6-a301-a173f7d24c39', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4d711e-d50e-41c3-aeb5-c897fb908996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4d711e-d50e-41c3-aeb5-c897fb908996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3704f45b-196b-49a4-9d78-2253d2a2a332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:23 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Volume 66059b3d-c574-40b6-a301-a173f7d24c39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66059b3d-c574-40b6-a301-a173f7d24c39', 'volume_size': 1}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bef2532-fbba-46b9-8a3b-cb51bdc38f22]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:12:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.b7a87e89-3699-469e-a241-236cac0661f9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:23 devstack sudo[101071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be9e568f-fcff-41e9-bcf5-15b53be52299_gd19s178
Sep 07 18:12:23 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:23 devstack sudo[101072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.b7a87e89-3699-469e-a241-236cac0661f9
Sep 07 18:12:23 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:24 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be9e568f-fcff-41e9-bcf5-15b53be52299_gd19s178" returned: 1 in 0.419s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be9e568f-fcff-41e9-bcf5-15b53be52299_gd19s178' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 07 18:12:24 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d89bee5-59c2-414e-a8b7-807c04020d38]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:12:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be9e568f-fcff-41e9-bcf5-15b53be52299_pr8jjh4bdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:24 devstack sudo[101077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be9e568f-fcff-41e9-bcf5-15b53be52299_pr8jjh4bdevstack@QuobyteHD
Sep 07 18:12:24 devstack sudo[101077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:24 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.b7a87e89-3699-469e-a241-236cac0661f9" returned: 0 in 0.549s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:12:24 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ef7462-aea7-4f8b-8fbc-ca60c71de6d8]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:12:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:24 devstack sudo[101082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6
Sep 07 18:12:24 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:24 devstack sudo[101077]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_be9e568f-fcff-41e9-bcf5-15b53be52299_pr8jjh4bdevstack@QuobyteHD" returned: 0 in 0.501s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:24 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] be9e568f-fcff-41e9-bcf5-15b53be52299 was qcow2, converting to qcow2 {{(pid=87269) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 07 18:12:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be9e568f-fcff-41e9-bcf5-15b53be52299_pr8jjh4bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28d785ce-cdd7-4aea-a838-2baad8895863 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:24 devstack sudo[101091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be9e568f-fcff-41e9-bcf5-15b53be52299_pr8jjh4bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28d785ce-cdd7-4aea-a838-2baad8895863
Sep 07 18:12:24 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:24 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6" returned: 0 in 0.466s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] will copy from snapshot at /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6 {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 07 18:12:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Creating direct copy from snapshot {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 07 18:12:24 devstack cinder-volume[87269]: DEBUG cinder.utils [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Path /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b7fab6c5-326c-4600-977c-4affec6c398b not found in is_blk_device check {{(pid=87269) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 07 18:12:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b7fab6c5-326c-4600-977c-4affec6c398b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:24 devstack sudo[101096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b7fab6c5-326c-4600-977c-4affec6c398b
Sep 07 18:12:24 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:28 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_be9e568f-fcff-41e9-bcf5-15b53be52299_pr8jjh4bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28d785ce-cdd7-4aea-a838-2baad8895863" returned: 0 in 4.190s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:28 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_be9e568f-fcff-41e9-bcf5-15b53be52299_pr8jjh4bdevstack@QuobyteHD, size 112.00 MB, duration 4.19 sec, destination /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28d785ce-cdd7-4aea-a838-2baad8895863 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 07 18:12:28 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Converted 112.00 MB image at 26.72 MB/s
Sep 07 18:12:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28d785ce-cdd7-4aea-a838-2baad8895863 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:28 devstack sudo[101115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28d785ce-cdd7-4aea-a838-2baad8895863 1G
Sep 07 18:12:28 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:29 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28d785ce-cdd7-4aea-a838-2baad8895863 1G" returned: 0 in 0.974s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:29 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Downloaded image be9e568f-fcff-41e9-bcf5-15b53be52299 ((None, [{'url': 'file:///opt/stack/data/glance/images/be9e568f-fcff-41e9-bcf5-15b53be52299', 'metadata': {}}])) to volume 28d785ce-cdd7-4aea-a838-2baad8895863 successfully. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 07 18:12:29 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Temporary image be9e568f-fcff-41e9-bcf5-15b53be52299 for user 890cf4c114614387b43ae544cd2973ba is deleted. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 07 18:12:29 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Marking volume 28d785ce-cdd7-4aea-a838-2baad8895863 as bootable. {{(pid=87269) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 07 18:12:29 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Copying metadata from image be9e568f-fcff-41e9-bcf5-15b53be52299 to 28d785ce-cdd7-4aea-a838-2baad8895863. {{(pid=87269) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 07 18:12:29 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Creating volume glance metadata for volume 28d785ce-cdd7-4aea-a838-2baad8895863 backed by image be9e568f-fcff-41e9-bcf5-15b53be52299 with: {'image_id': 'be9e568f-fcff-41e9-bcf5-15b53be52299', 'image_name': 'tempest-scenario-img--1030789315', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87269) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 07 18:12:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76927031-9fda-4ad5-a6c2-7bad5344c84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28d785ce-cdd7-4aea-a838-2baad8895863', 'volume_size': 1, 'image_id': 'be9e568f-fcff-41e9-bcf5-15b53be52299', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be9e568f-fcff-41e9-bcf5-15b53be52299', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1030789315', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ad384f92ace14672876b90d57726e369', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'be9e568f-fcff-41e9-bcf5-15b53be52299', 'created_at': datetime.datetime(2026, 9, 7, 16, 12, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 16, 12, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be9e568f-fcff-41e9-bcf5-15b53be52299/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d160b8ea510>}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21e5e68-6be4-4fb1-86ad-0c9cc97c9d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:30 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Volume volume-28d785ce-cdd7-4aea-a838-2baad8895863 (28d785ce-cdd7-4aea-a838-2baad8895863): created successfully
Sep 07 18:12:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21e5e68-6be4-4fb1-86ad-0c9cc97c9d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Flow 'volume_create_manager' (a47ceeb4-c3ad-42c4-8f59-9bdab9c02e98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:12:30 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-368b0d56-c9b8-4e95-9a08-9a6c6af5a099 tempest-TestInstancesWithCinderVolumes-601362612 None] Created volume successfully.
Sep 07 18:12:31 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b7fab6c5-326c-4600-977c-4affec6c398b" returned: 0 in 7.180s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:31 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Image conversion details: src /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6, size 1024.00 MB, duration 7.18 sec, destination /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b7fab6c5-326c-4600-977c-4affec6c398b {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 07 18:12:31 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Converted 1024.00 MB image at 142.60 MB/s
Sep 07 18:12:31 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b7fab6c5-326c-4600-977c-4affec6c398b is being set with open permissions: ugo+rw
Sep 07 18:12:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b7fab6c5-326c-4600-977c-4affec6c398b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:31 devstack sudo[101124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b7fab6c5-326c-4600-977c-4affec6c398b
Sep 07 18:12:31 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:32 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b7fab6c5-326c-4600-977c-4affec6c398b" returned: 0 in 0.403s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Lock "cinder-quobyte-b7fab6c5-326c-4600-977c-4affec6c398b" released by "_copy_volume_from_snapshot" :: held 8.792s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:12:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Lock "cinder-quobyte-b7a87e89-3699-469e-a241-236cac0661f9-b7fab6c5-326c-4600-977c-4affec6c398b" released by "_create_volume_from_snapshot" :: held 8.949s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:12:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.991s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.752s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1081704063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66059b3d-c574-40b6-a301-a173f7d24c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55dfcffc70e34ecb95f742ef0f78ca68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:12:23Z,use_quota=True,user_id='a922426ef7f149e0b04410c6d5253fd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:12:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Creating volume 66059b3d-c574-40b6-a301-a173f7d24c39 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:12:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:12:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:12:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:12:32 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:12:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-66059b3d-c574-40b6-a301-a173f7d24c39 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:32 devstack sudo[101139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-66059b3d-c574-40b6-a301-a173f7d24c39 1073741824
Sep 07 18:12:32 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2c5a7a7-b981-45c5-9933-e15246c3c08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7fab6c5-326c-4600-977c-4affec6c398b', 'volume_size': 1, 'snapshot_id': 'b7a87e89-3699-469e-a241-236cac0661f9'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aeb38d5-5795-445c-b056-0f0bb8217598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:32 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Volume volume-b7fab6c5-326c-4600-977c-4affec6c398b (b7fab6c5-326c-4600-977c-4affec6c398b): created successfully
Sep 07 18:12:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aeb38d5-5795-445c-b056-0f0bb8217598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Flow 'volume_create_manager' (f905cb8c-cc0c-4438-805b-12d03db66210) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:12:32 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-71f931bf-e263-4052-9bd4-edf1962a7f08 tempest-TestStampPattern-2010018532 None] Created volume successfully.
Sep 07 18:12:33 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-66059b3d-c574-40b6-a301-a173f7d24c39 1073741824" returned: 0 in 0.752s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-66059b3d-c574-40b6-a301-a173f7d24c39 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:33 devstack sudo[101160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-66059b3d-c574-40b6-a301-a173f7d24c39
Sep 07 18:12:33 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:33 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-66059b3d-c574-40b6-a301-a173f7d24c39" returned: 0 in 0.401s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:12:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3704f45b-196b-49a4-9d78-2253d2a2a332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66059b3d-c574-40b6-a301-a173f7d24c39', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b31040b-64ae-4f62-9dd6-6c56542258b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:33 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Volume volume-66059b3d-c574-40b6-a301-a173f7d24c39 (66059b3d-c574-40b6-a301-a173f7d24c39): created successfully
Sep 07 18:12:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b31040b-64ae-4f62-9dd6-6c56542258b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Flow 'volume_create_manager' (4959b624-4c73-4b95-a798-252c9296392b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:12:33 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-c09d8901-fece-4281-bbe4-994cf4b9da4c tempest-ProjectReaderTests-1433924159 None] Created volume successfully.
Sep 07 18:12:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-72c12f5d-f4ed-46b2-8a5f-cb884cfbcc48 tempest-ProjectReaderTests-1433924159 None] Acquiring lock "cinder-66059b3d-c574-40b6-a301-a173f7d24c39-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:12:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-72c12f5d-f4ed-46b2-8a5f-cb884cfbcc48 tempest-ProjectReaderTests-1433924159 None] Lock "cinder-66059b3d-c574-40b6-a301-a173f7d24c39-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:12:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-72c12f5d-f4ed-46b2-8a5f-cb884cfbcc48 tempest-ProjectReaderTests-1433924159 None] Acquiring lock "cinder-quobyte-66059b3d-c574-40b6-a301-a173f7d24c39" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:12:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-72c12f5d-f4ed-46b2-8a5f-cb884cfbcc48 tempest-ProjectReaderTests-1433924159 None] Lock "cinder-quobyte-66059b3d-c574-40b6-a301-a173f7d24c39" acquired by "delete_volume" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:12:35 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbc43c6-a80e-49e9-9dfe-62f38cf097a4]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:12:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-72c12f5d-f4ed-46b2-8a5f-cb884cfbcc48 tempest-ProjectReaderTests-1433924159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-66059b3d-c574-40b6-a301-a173f7d24c39 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:35 devstack sudo[101204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-66059b3d-c574-40b6-a301-a173f7d24c39
Sep 07 18:12:35 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:35 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-72c12f5d-f4ed-46b2-8a5f-cb884cfbcc48 tempest-ProjectReaderTests-1433924159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-66059b3d-c574-40b6-a301-a173f7d24c39" returned: 0 in 0.600s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-72c12f5d-f4ed-46b2-8a5f-cb884cfbcc48 tempest-ProjectReaderTests-1433924159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-66059b3d-c574-40b6-a301-a173f7d24c39 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:35 devstack sudo[101210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-66059b3d-c574-40b6-a301-a173f7d24c39
Sep 07 18:12:35 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:36 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-72c12f5d-f4ed-46b2-8a5f-cb884cfbcc48 tempest-ProjectReaderTests-1433924159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-66059b3d-c574-40b6-a301-a173f7d24c39" returned: 0 in 0.412s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-72c12f5d-f4ed-46b2-8a5f-cb884cfbcc48 tempest-ProjectReaderTests-1433924159 None] Lock "cinder-quobyte-66059b3d-c574-40b6-a301-a173f7d24c39" released by "delete_volume" :: held 1.114s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:12:36 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-72c12f5d-f4ed-46b2-8a5f-cb884cfbcc48 tempest-ProjectReaderTests-1433924159 None] Created reservations ['6918ad0b-7887-4ab5-a9c9-cd00699572e8', '11bae415-04aa-4003-a45b-d3077450883b', '3e2d42ae-8174-4f7c-b2a6-28ca329f80a5', 'e47ed60d-6424-4349-821c-a5a2c64f9de3'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:12:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-72c12f5d-f4ed-46b2-8a5f-cb884cfbcc48 tempest-ProjectReaderTests-1433924159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-72c12f5d-f4ed-46b2-8a5f-cb884cfbcc48 tempest-ProjectReaderTests-1433924159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-72c12f5d-f4ed-46b2-8a5f-cb884cfbcc48 tempest-ProjectReaderTests-1433924159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:12:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-72c12f5d-f4ed-46b2-8a5f-cb884cfbcc48 tempest-ProjectReaderTests-1433924159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:12:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-72c12f5d-f4ed-46b2-8a5f-cb884cfbcc48 tempest-ProjectReaderTests-1433924159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-72c12f5d-f4ed-46b2-8a5f-cb884cfbcc48 tempest-ProjectReaderTests-1433924159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:36 devstack sudo[101224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:12:36 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-d13ef819-1027-4314-8f52-64fbec35649c req-811e500d-1f78-447a-9b93-a39e9f62e33d tempest-TestInstancesWithCinderVolumes-601362612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-d13ef819-1027-4314-8f52-64fbec35649c req-811e500d-1f78-447a-9b93-a39e9f62e33d tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-d13ef819-1027-4314-8f52-64fbec35649c req-811e500d-1f78-447a-9b93-a39e9f62e33d tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-d13ef819-1027-4314-8f52-64fbec35649c req-811e500d-1f78-447a-9b93-a39e9f62e33d tempest-TestInstancesWithCinderVolumes-601362612 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d', 'name': 'volume-28d785ce-cdd7-4aea-a838-2baad8895863', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'beaa575b-7845-4013-8d84-9273eca30bfa', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 07 18:12:36 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-d13ef819-1027-4314-8f52-64fbec35649c req-811e500d-1f78-447a-9b93-a39e9f62e33d tempest-TestInstancesWithCinderVolumes-601362612 None] attachment_update completed successfully.
Sep 07 18:12:37 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-72c12f5d-f4ed-46b2-8a5f-cb884cfbcc48 tempest-ProjectReaderTests-1433924159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.552s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:37 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-72c12f5d-f4ed-46b2-8a5f-cb884cfbcc48 tempest-ProjectReaderTests-1433924159 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:12:37 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-72c12f5d-f4ed-46b2-8a5f-cb884cfbcc48 tempest-ProjectReaderTests-1433924159 None] Deleted volume successfully.
Sep 07 18:12:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-72c12f5d-f4ed-46b2-8a5f-cb884cfbcc48 tempest-ProjectReaderTests-1433924159 None] Lock "cinder-66059b3d-c574-40b6-a301-a173f7d24c39-delete_volume" released by "delete_volume" :: held 2.231s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:12:50 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=72,cinder:UPDATE=83,cinder:DELETE=6,cinder:INSERT=19 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:12:50 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=82,cinder:UPDATE=78,cinder:INSERT=25,cinder:DELETE=10 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:12:58 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:12:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Flow 'volume_create_manager' (3529205b-82f4-4b78-b845-19be11fb73cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:12:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42fcf17-496c-454a-bfc0-ff468bd2593a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42fcf17-496c-454a-bfc0-ff468bd2593a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1502861611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d83009-e6b9-4495-bf30-fe43b20ff2d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d74a3ca190354312bf59c5b6a82cf660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:12:59Z,use_quota=True,user_id='2c8094f55d0e4d85b5ad89ef6fdcffea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d98dcb-7af0-4637-a8ba-6d928c35b2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d98dcb-7af0-4637-a8ba-6d928c35b2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f4ac8c-1a18-4b28-86d4-563a54e2f99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f4ac8c-1a18-4b28-86d4-563a54e2f99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33d83009-e6b9-4495-bf30-fe43b20ff2d6', 'volume_name': 'volume-33d83009-e6b9-4495-bf30-fe43b20ff2d6', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a5fefd-a4c8-4d1f-a039-0932b3d9a2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3a5fefd-a4c8-4d1f-a039-0932b3d9a2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2625f90a-7420-49ed-afb1-4a5eccf1ba0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:58 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Volume 33d83009-e6b9-4495-bf30-fe43b20ff2d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33d83009-e6b9-4495-bf30-fe43b20ff2d6', 'volume_size': 1}
Sep 07 18:12:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1502861611',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d83009-e6b9-4495-bf30-fe43b20ff2d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d74a3ca190354312bf59c5b6a82cf660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:12:59Z,use_quota=True,user_id='2c8094f55d0e4d85b5ad89ef6fdcffea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:12:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Creating volume 33d83009-e6b9-4495-bf30-fe43b20ff2d6 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:12:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:12:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:12:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:12:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:12:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:12:58 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:12:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-33d83009-e6b9-4495-bf30-fe43b20ff2d6 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:58 devstack sudo[101709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-33d83009-e6b9-4495-bf30-fe43b20ff2d6 1073741824
Sep 07 18:12:58 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:59 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-33d83009-e6b9-4495-bf30-fe43b20ff2d6 1073741824" returned: 0 in 0.417s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-33d83009-e6b9-4495-bf30-fe43b20ff2d6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:59 devstack sudo[101714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-33d83009-e6b9-4495-bf30-fe43b20ff2d6
Sep 07 18:12:59 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:12:59 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root
Sep 07 18:12:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-33d83009-e6b9-4495-bf30-fe43b20ff2d6" returned: 0 in 0.254s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:12:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:12:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:12:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2625f90a-7420-49ed-afb1-4a5eccf1ba0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33d83009-e6b9-4495-bf30-fe43b20ff2d6', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17015896-6122-45bf-b815-ea21eaba068e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:12:59 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Volume volume-33d83009-e6b9-4495-bf30-fe43b20ff2d6 (33d83009-e6b9-4495-bf30-fe43b20ff2d6): created successfully
Sep 07 18:12:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17015896-6122-45bf-b815-ea21eaba068e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:12:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Flow 'volume_create_manager' (3529205b-82f4-4b78-b845-19be11fb73cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:12:59 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b5afcb6d-4ece-40d6-81da-ad25fb2359c3 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Created volume successfully.
Sep 07 18:12:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1b723a46-e46e-446a-92d9-e774516d928c tempest-VolumeQuotasAdminTestJSON-1680578092 None] Acquiring lock "cinder-33d83009-e6b9-4495-bf30-fe43b20ff2d6-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:12:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1b723a46-e46e-446a-92d9-e774516d928c tempest-VolumeQuotasAdminTestJSON-1680578092 None] Lock "cinder-33d83009-e6b9-4495-bf30-fe43b20ff2d6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:12:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1b723a46-e46e-446a-92d9-e774516d928c tempest-VolumeQuotasAdminTestJSON-1680578092 None] Acquiring lock "cinder-quobyte-33d83009-e6b9-4495-bf30-fe43b20ff2d6" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:12:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1b723a46-e46e-446a-92d9-e774516d928c tempest-VolumeQuotasAdminTestJSON-1680578092 None] Lock "cinder-quobyte-33d83009-e6b9-4495-bf30-fe43b20ff2d6" acquired by "delete_volume" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:12:59 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafabffd-c0f7-453c-9c76-10a45b4d0bca]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:12:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1b723a46-e46e-446a-92d9-e774516d928c tempest-VolumeQuotasAdminTestJSON-1680578092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-33d83009-e6b9-4495-bf30-fe43b20ff2d6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:12:59 devstack sudo[101717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-33d83009-e6b9-4495-bf30-fe43b20ff2d6
Sep 07 18:12:59 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:00 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1b723a46-e46e-446a-92d9-e774516d928c tempest-VolumeQuotasAdminTestJSON-1680578092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-33d83009-e6b9-4495-bf30-fe43b20ff2d6" returned: 0 in 0.394s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1b723a46-e46e-446a-92d9-e774516d928c tempest-VolumeQuotasAdminTestJSON-1680578092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-33d83009-e6b9-4495-bf30-fe43b20ff2d6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:00 devstack sudo[101726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-33d83009-e6b9-4495-bf30-fe43b20ff2d6
Sep 07 18:13:00 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:00 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1b723a46-e46e-446a-92d9-e774516d928c tempest-VolumeQuotasAdminTestJSON-1680578092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-33d83009-e6b9-4495-bf30-fe43b20ff2d6" returned: 0 in 0.268s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1b723a46-e46e-446a-92d9-e774516d928c tempest-VolumeQuotasAdminTestJSON-1680578092 None] Lock "cinder-quobyte-33d83009-e6b9-4495-bf30-fe43b20ff2d6" released by "delete_volume" :: held 0.706s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:00 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-1b723a46-e46e-446a-92d9-e774516d928c tempest-VolumeQuotasAdminTestJSON-1680578092 None] Created reservations ['6c1c08a2-0009-4ec7-92dc-c49c011124fb', 'c931836a-d612-44d8-8a4c-97af6d4bd986', 'b501ba4f-dddc-4a97-8bca-8daba52404c5', '4f818a18-a954-45e7-bdc4-d9da6b4667ba'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:13:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1b723a46-e46e-446a-92d9-e774516d928c tempest-VolumeQuotasAdminTestJSON-1680578092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1b723a46-e46e-446a-92d9-e774516d928c tempest-VolumeQuotasAdminTestJSON-1680578092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1b723a46-e46e-446a-92d9-e774516d928c tempest-VolumeQuotasAdminTestJSON-1680578092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1b723a46-e46e-446a-92d9-e774516d928c tempest-VolumeQuotasAdminTestJSON-1680578092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1b723a46-e46e-446a-92d9-e774516d928c tempest-VolumeQuotasAdminTestJSON-1680578092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1b723a46-e46e-446a-92d9-e774516d928c tempest-VolumeQuotasAdminTestJSON-1680578092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:00 devstack sudo[101730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:13:00 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:00 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:13:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:00 devstack sudo[101756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:13:00 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:00 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1b723a46-e46e-446a-92d9-e774516d928c tempest-VolumeQuotasAdminTestJSON-1680578092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.369s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:00 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-1b723a46-e46e-446a-92d9-e774516d928c tempest-VolumeQuotasAdminTestJSON-1680578092 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:13:01 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-1b723a46-e46e-446a-92d9-e774516d928c tempest-VolumeQuotasAdminTestJSON-1680578092 None] Deleted volume successfully.
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1b723a46-e46e-446a-92d9-e774516d928c tempest-VolumeQuotasAdminTestJSON-1680578092 None] Lock "cinder-33d83009-e6b9-4495-bf30-fe43b20ff2d6-delete_volume" released by "delete_volume" :: held 1.360s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:01 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.342s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread info: [<_MainThread(MainThread, started 137533762306176)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137533650971072)>, <Thread(Thread-3 (stat_writer), started daemon 137533647226880)>, <Thread(Rabbit-heartbeat, started daemon 137533647437120)>, <Thread(Thread-5 (_runner), started daemon 137533648120896)>, <Thread(Thread-7 (_runner), started daemon 137533648182592)>, <Thread(fd_logger, started daemon 137533644336576)>, <Thread(privsep_reader, started daemon 137533643255424)>, <Thread(tpool_thread_0, started daemon 137533635446464)>, <Thread(tpool_thread_1, started daemon 137533627053760)>, <Thread(tpool_thread_2, started daemon 137533618661056)>, <Thread(tpool_thread_3, started daemon 137533610251968)>, <Thread(tpool_thread_4, started daemon 137533601842880)>, <Thread(tpool_thread_5, started daemon 137533593433792)>, <Thread(tpool_thread_6, started daemon 137533585024704)>, <Thread(tpool_thread_7, started daemon 137533576615616)>, <Thread(tpool_thread_8, started daemon 137533568206528)>, <Thread(tpool_thread_9, started daemon 137533559797440)>, <Thread(tpool_thread_10, started daemon 137533551388352)>, <Thread(tpool_thread_11, started daemon 137533542979264)>, <Thread(tpool_thread_12, started daemon 137533534570176)>, <Thread(tpool_thread_13, started daemon 137533526161088)>, <Thread(tpool_thread_14, started daemon 137533517752000)>, <Thread(tpool_thread_15, started daemon 137533509342912)>, <Thread(tpool_thread_16, started daemon 137533500933824)>, <Thread(tpool_thread_17, started daemon 137533492524736)>, <Thread(tpool_thread_18, started daemon 137533484115648)>, <Thread(tpool_thread_19, started daemon 137533475706560)>] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Flow 'volume_create_manager' (b3af026c-2f85-43e1-81e4-f55af309e36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ad41ce-819b-42e9-8672-6492c6554cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03ad41ce-819b-42e9-8672-6492c6554cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1638608709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27b2301c-293d-4b10-8e38-4496bcc8b275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d74a3ca190354312bf59c5b6a82cf660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:13:01Z,use_quota=True,user_id='2c8094f55d0e4d85b5ad89ef6fdcffea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80348b96-6bfa-4237-892c-8a6d958cbb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80348b96-6bfa-4237-892c-8a6d958cbb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d631244-4839-4b36-ab94-3de493221b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d631244-4839-4b36-ab94-3de493221b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27b2301c-293d-4b10-8e38-4496bcc8b275', 'volume_name': 'volume-27b2301c-293d-4b10-8e38-4496bcc8b275', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4d7c83-16d4-4b20-8147-c2831239bb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4d7c83-16d4-4b20-8147-c2831239bb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c4c2d2-fa7e-4786-a5d0-4c13e086d5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:01 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Volume 27b2301c-293d-4b10-8e38-4496bcc8b275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27b2301c-293d-4b10-8e38-4496bcc8b275', 'volume_size': 1}
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1638608709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27b2301c-293d-4b10-8e38-4496bcc8b275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d74a3ca190354312bf59c5b6a82cf660',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:13:01Z,use_quota=True,user_id='2c8094f55d0e4d85b5ad89ef6fdcffea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Creating volume 27b2301c-293d-4b10-8e38-4496bcc8b275 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:13:01 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:13:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-27b2301c-293d-4b10-8e38-4496bcc8b275 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:01 devstack sudo[101769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-27b2301c-293d-4b10-8e38-4496bcc8b275 1073741824
Sep 07 18:13:01 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:02 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-27b2301c-293d-4b10-8e38-4496bcc8b275 1073741824" returned: 0 in 0.440s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-27b2301c-293d-4b10-8e38-4496bcc8b275 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:02 devstack sudo[101775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-27b2301c-293d-4b10-8e38-4496bcc8b275
Sep 07 18:13:02 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:02 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-27b2301c-293d-4b10-8e38-4496bcc8b275" returned: 0 in 0.244s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:13:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66c4c2d2-fa7e-4786-a5d0-4c13e086d5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27b2301c-293d-4b10-8e38-4496bcc8b275', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc819e7d-7e1c-4bf5-a13a-61c3e9f11826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:02 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Volume volume-27b2301c-293d-4b10-8e38-4496bcc8b275 (27b2301c-293d-4b10-8e38-4496bcc8b275): created successfully
Sep 07 18:13:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc819e7d-7e1c-4bf5-a13a-61c3e9f11826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Flow 'volume_create_manager' (b3af026c-2f85-43e1-81e4-f55af309e36b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:13:02 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f57c51b1-27a7-4c2d-a707-2f01c54c3dc6 tempest-VolumeQuotasAdminTestJSON-1680578092 None] Created volume successfully.
Sep 07 18:13:04 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e0de6ae1-6594-4a55-8bff-c34e8a60d71c tempest-VolumeQuotasAdminTestJSON-923043658 None] Transfer volume completed successfully.
Sep 07 18:13:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2c5802ad-9ff5-42a8-9506-a0d2e0da3448 tempest-VolumeQuotasAdminTestJSON-985358858 None] Acquiring lock "cinder-27b2301c-293d-4b10-8e38-4496bcc8b275-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2c5802ad-9ff5-42a8-9506-a0d2e0da3448 tempest-VolumeQuotasAdminTestJSON-985358858 None] Lock "cinder-27b2301c-293d-4b10-8e38-4496bcc8b275-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2c5802ad-9ff5-42a8-9506-a0d2e0da3448 tempest-VolumeQuotasAdminTestJSON-985358858 None] Acquiring lock "cinder-quobyte-27b2301c-293d-4b10-8e38-4496bcc8b275" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2c5802ad-9ff5-42a8-9506-a0d2e0da3448 tempest-VolumeQuotasAdminTestJSON-985358858 None] Lock "cinder-quobyte-27b2301c-293d-4b10-8e38-4496bcc8b275" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:04 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f8b5f8-f784-4798-a125-98d54567b3c1]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:13:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c5802ad-9ff5-42a8-9506-a0d2e0da3448 tempest-VolumeQuotasAdminTestJSON-985358858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-27b2301c-293d-4b10-8e38-4496bcc8b275 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:04 devstack sudo[101782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-27b2301c-293d-4b10-8e38-4496bcc8b275
Sep 07 18:13:04 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:05 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c5802ad-9ff5-42a8-9506-a0d2e0da3448 tempest-VolumeQuotasAdminTestJSON-985358858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-27b2301c-293d-4b10-8e38-4496bcc8b275" returned: 0 in 0.385s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c5802ad-9ff5-42a8-9506-a0d2e0da3448 tempest-VolumeQuotasAdminTestJSON-985358858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-27b2301c-293d-4b10-8e38-4496bcc8b275 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:05 devstack sudo[101790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-27b2301c-293d-4b10-8e38-4496bcc8b275
Sep 07 18:13:05 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:05 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c5802ad-9ff5-42a8-9506-a0d2e0da3448 tempest-VolumeQuotasAdminTestJSON-985358858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-27b2301c-293d-4b10-8e38-4496bcc8b275" returned: 0 in 0.301s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2c5802ad-9ff5-42a8-9506-a0d2e0da3448 tempest-VolumeQuotasAdminTestJSON-985358858 None] Lock "cinder-quobyte-27b2301c-293d-4b10-8e38-4496bcc8b275" released by "delete_volume" :: held 0.724s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:05 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-2c5802ad-9ff5-42a8-9506-a0d2e0da3448 tempest-VolumeQuotasAdminTestJSON-985358858 None] Created reservations ['8d7835aa-1c2a-498c-ac61-670195329c27', '5500fe5e-00d1-419d-939e-73e612664e85', 'c7f090bf-8b38-48c5-b873-c43405569541', 'd95933d7-9a2d-4858-8c1e-0980d6d31f12'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:13:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2c5802ad-9ff5-42a8-9506-a0d2e0da3448 tempest-VolumeQuotasAdminTestJSON-985358858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2c5802ad-9ff5-42a8-9506-a0d2e0da3448 tempest-VolumeQuotasAdminTestJSON-985358858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2c5802ad-9ff5-42a8-9506-a0d2e0da3448 tempest-VolumeQuotasAdminTestJSON-985358858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2c5802ad-9ff5-42a8-9506-a0d2e0da3448 tempest-VolumeQuotasAdminTestJSON-985358858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2c5802ad-9ff5-42a8-9506-a0d2e0da3448 tempest-VolumeQuotasAdminTestJSON-985358858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c5802ad-9ff5-42a8-9506-a0d2e0da3448 tempest-VolumeQuotasAdminTestJSON-985358858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:05 devstack sudo[101801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:13:05 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-ac647c47-89c8-45ea-8823-56e649c7063f req-d8c7bc68-29d8-42e7-b4fd-11f0c8445a90 tempest-TestStampPattern-2010018532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-ac647c47-89c8-45ea-8823-56e649c7063f req-d8c7bc68-29d8-42e7-b4fd-11f0c8445a90 tempest-TestStampPattern-2010018532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-ac647c47-89c8-45ea-8823-56e649c7063f req-d8c7bc68-29d8-42e7-b4fd-11f0c8445a90 tempest-TestStampPattern-2010018532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-ac647c47-89c8-45ea-8823-56e649c7063f req-d8c7bc68-29d8-42e7-b4fd-11f0c8445a90 tempest-TestStampPattern-2010018532 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d', 'name': 'volume-b7fab6c5-326c-4600-977c-4affec6c398b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '552299d5-dccc-4324-adbf-16e5136a4bed', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 07 18:13:05 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-ac647c47-89c8-45ea-8823-56e649c7063f req-d8c7bc68-29d8-42e7-b4fd-11f0c8445a90 tempest-TestStampPattern-2010018532 None] attachment_update completed successfully.
Sep 07 18:13:05 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2c5802ad-9ff5-42a8-9506-a0d2e0da3448 tempest-VolumeQuotasAdminTestJSON-985358858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.272s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:05 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-2c5802ad-9ff5-42a8-9506-a0d2e0da3448 tempest-VolumeQuotasAdminTestJSON-985358858 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:13:05 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2c5802ad-9ff5-42a8-9506-a0d2e0da3448 tempest-VolumeQuotasAdminTestJSON-985358858 None] Deleted volume successfully.
Sep 07 18:13:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2c5802ad-9ff5-42a8-9506-a0d2e0da3448 tempest-VolumeQuotasAdminTestJSON-985358858 None] Lock "cinder-27b2301c-293d-4b10-8e38-4496bcc8b275-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:07 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-06e614b7-9b8a-4326-8e20-d41f2b3f2e3e req-51edc3ed-eb6c-4557-80fa-1bbdf2837211 tempest-TestStampPattern-2010018532 None] Terminate volume connection completed successfully.
Sep 07 18:13:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-06e614b7-9b8a-4326-8e20-d41f2b3f2e3e req-51edc3ed-eb6c-4557-80fa-1bbdf2837211 tempest-TestStampPattern-2010018532 None] Deleting attachment 552299d5-dccc-4324-adbf-16e5136a4bed. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 07 18:13:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-164f2370-9dca-4108-9b27-4c3a27e4d372 tempest-TestStampPattern-2010018532 None] Acquiring lock "cinder-b7fab6c5-326c-4600-977c-4affec6c398b-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-164f2370-9dca-4108-9b27-4c3a27e4d372 tempest-TestStampPattern-2010018532 None] Lock "cinder-b7fab6c5-326c-4600-977c-4affec6c398b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-164f2370-9dca-4108-9b27-4c3a27e4d372 tempest-TestStampPattern-2010018532 None] Acquiring lock "cinder-quobyte-b7fab6c5-326c-4600-977c-4affec6c398b" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-164f2370-9dca-4108-9b27-4c3a27e4d372 tempest-TestStampPattern-2010018532 None] Lock "cinder-quobyte-b7fab6c5-326c-4600-977c-4affec6c398b" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:12 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ff3ca1-ac6e-4cac-af15-ce7584931814]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:13:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-164f2370-9dca-4108-9b27-4c3a27e4d372 tempest-TestStampPattern-2010018532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b7fab6c5-326c-4600-977c-4affec6c398b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:12 devstack sudo[101902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b7fab6c5-326c-4600-977c-4affec6c398b
Sep 07 18:13:12 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:13 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-164f2370-9dca-4108-9b27-4c3a27e4d372 tempest-TestStampPattern-2010018532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b7fab6c5-326c-4600-977c-4affec6c398b" returned: 0 in 0.448s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-164f2370-9dca-4108-9b27-4c3a27e4d372 tempest-TestStampPattern-2010018532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b7fab6c5-326c-4600-977c-4affec6c398b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:13 devstack sudo[101911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b7fab6c5-326c-4600-977c-4affec6c398b
Sep 07 18:13:13 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:13 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-164f2370-9dca-4108-9b27-4c3a27e4d372 tempest-TestStampPattern-2010018532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b7fab6c5-326c-4600-977c-4affec6c398b" returned: 0 in 0.267s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-164f2370-9dca-4108-9b27-4c3a27e4d372 tempest-TestStampPattern-2010018532 None] Lock "cinder-quobyte-b7fab6c5-326c-4600-977c-4affec6c398b" released by "delete_volume" :: held 0.765s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-ad7d2d51-ebcf-44f0-99a0-5f36811704bf req-8dde9244-c8e6-451d-964c-2707c8710997 tempest-TestInstancesWithCinderVolumes-601362612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-ad7d2d51-ebcf-44f0-99a0-5f36811704bf req-8dde9244-c8e6-451d-964c-2707c8710997 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-ad7d2d51-ebcf-44f0-99a0-5f36811704bf req-8dde9244-c8e6-451d-964c-2707c8710997 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-ad7d2d51-ebcf-44f0-99a0-5f36811704bf req-8dde9244-c8e6-451d-964c-2707c8710997 tempest-TestInstancesWithCinderVolumes-601362612 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d', 'name': 'volume-0fcc75ec-20cd-47e0-8277-50ededb3dd29', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c82c005d-f647-4498-96d3-e0e9ec2dfaea', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 07 18:13:13 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-164f2370-9dca-4108-9b27-4c3a27e4d372 tempest-TestStampPattern-2010018532 None] Created reservations ['395b1d58-97a4-4e34-a237-27d9e1085b4a', 'fe5922de-1130-4e10-9ec7-22b3ed80c7b3', '1768aee9-3681-488b-98dc-ad6f315a4119', '9ea2a30c-d968-446a-8020-ce41da97ec38'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:13:13 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-ad7d2d51-ebcf-44f0-99a0-5f36811704bf req-8dde9244-c8e6-451d-964c-2707c8710997 tempest-TestInstancesWithCinderVolumes-601362612 None] attachment_update completed successfully.
Sep 07 18:13:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-164f2370-9dca-4108-9b27-4c3a27e4d372 tempest-TestStampPattern-2010018532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-164f2370-9dca-4108-9b27-4c3a27e4d372 tempest-TestStampPattern-2010018532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-164f2370-9dca-4108-9b27-4c3a27e4d372 tempest-TestStampPattern-2010018532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-164f2370-9dca-4108-9b27-4c3a27e4d372 tempest-TestStampPattern-2010018532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-164f2370-9dca-4108-9b27-4c3a27e4d372 tempest-TestStampPattern-2010018532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-164f2370-9dca-4108-9b27-4c3a27e4d372 tempest-TestStampPattern-2010018532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:13 devstack sudo[101922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:13:13 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:13 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-164f2370-9dca-4108-9b27-4c3a27e4d372 tempest-TestStampPattern-2010018532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.340s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:13 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-164f2370-9dca-4108-9b27-4c3a27e4d372 tempest-TestStampPattern-2010018532 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:13:13 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-164f2370-9dca-4108-9b27-4c3a27e4d372 tempest-TestStampPattern-2010018532 None] Deleted volume successfully.
Sep 07 18:13:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-164f2370-9dca-4108-9b27-4c3a27e4d372 tempest-TestStampPattern-2010018532 None] Lock "cinder-b7fab6c5-326c-4600-977c-4affec6c398b-delete_volume" released by "delete_volume" :: held 1.386s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-372fcb61-8979-415e-9d86-9304ee2952a4 tempest-TestStampPattern-2010018532 None] Acquiring lock "cinder-b7a87e89-3699-469e-a241-236cac0661f9-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-372fcb61-8979-415e-9d86-9304ee2952a4 tempest-TestStampPattern-2010018532 None] Lock "cinder-b7a87e89-3699-469e-a241-236cac0661f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-372fcb61-8979-415e-9d86-9304ee2952a4 tempest-TestStampPattern-2010018532 None] Acquiring lock "cinder-quobyte-00f6df7a-566d-4d64-905f-5c33fc65d3f6" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-372fcb61-8979-415e-9d86-9304ee2952a4 tempest-TestStampPattern-2010018532 None] Lock "cinder-quobyte-00f6df7a-566d-4d64-905f-5c33fc65d3f6" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-372fcb61-8979-415e-9d86-9304ee2952a4 tempest-TestStampPattern-2010018532 None] Acquiring lock "cinder-quobyte-b7a87e89-3699-469e-a241-236cac0661f9" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-372fcb61-8979-415e-9d86-9304ee2952a4 tempest-TestStampPattern-2010018532 None] Lock "cinder-quobyte-b7a87e89-3699-469e-a241-236cac0661f9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-372fcb61-8979-415e-9d86-9304ee2952a4 tempest-TestStampPattern-2010018532 None] Deleting offline snapshot b7a87e89-3699-469e-a241-236cac0661f9 of volume 00f6df7a-566d-4d64-905f-5c33fc65d3f6 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-372fcb61-8979-415e-9d86-9304ee2952a4 tempest-TestStampPattern-2010018532 None] snapshot_file for this snap is: volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.b7a87e89-3699-469e-a241-236cac0661f9 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[845cbd50-823f-4996-b7ae-c1c8aee7e6f1]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-372fcb61-8979-415e-9d86-9304ee2952a4 tempest-TestStampPattern-2010018532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.b7a87e89-3699-469e-a241-236cac0661f9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:14 devstack sudo[101927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.b7a87e89-3699-469e-a241-236cac0661f9
Sep 07 18:13:14 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Flow 'volume_create_manager' (b417784b-eac1-4216-b394-0ce7f0b629cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e4b4839-7bfc-480c-90d8-c80cd828a105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:14 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e4b4839-7bfc-480c-90d8-c80cd828a105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-925728590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7396a42e-5071-4fe4-882b-7a989a918344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cb8ead97d5c44a1ab24db3f45c5bc01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:13:14Z,use_quota=True,user_id='b8521ef75ba24c518c77c8df3ad894ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(245c1864-2040-4cfb-88fb-a360fc6974a3),volume_type_id=245c1864-2040-4cfb-88fb-a360fc6974a3)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce14c1cb-2b13-4eb4-85ec-c6c6d315117a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce14c1cb-2b13-4eb4-85ec-c6c6d315117a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28dc0da-1332-495d-9d21-9c9d2799cb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a28dc0da-1332-495d-9d21-9c9d2799cb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7396a42e-5071-4fe4-882b-7a989a918344', 'volume_name': 'volume-7396a42e-5071-4fe4-882b-7a989a918344', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1420c991-b4f0-4dd2-abe7-9e0bf6fc23e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1420c991-b4f0-4dd2-abe7-9e0bf6fc23e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e3fbc46-abf5-4cfb-b4f7-951296ddaa21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:14 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Volume 7396a42e-5071-4fe4-882b-7a989a918344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7396a42e-5071-4fe4-882b-7a989a918344', 'volume_size': 1}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-925728590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7396a42e-5071-4fe4-882b-7a989a918344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cb8ead97d5c44a1ab24db3f45c5bc01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:13:14Z,use_quota=True,user_id='b8521ef75ba24c518c77c8df3ad894ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(245c1864-2040-4cfb-88fb-a360fc6974a3),volume_type_id=245c1864-2040-4cfb-88fb-a360fc6974a3)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Creating volume 7396a42e-5071-4fe4-882b-7a989a918344 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:13:14 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7396a42e-5071-4fe4-882b-7a989a918344 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-372fcb61-8979-415e-9d86-9304ee2952a4 tempest-TestStampPattern-2010018532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.b7a87e89-3699-469e-a241-236cac0661f9" returned: 0 in 0.491s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-372fcb61-8979-415e-9d86-9304ee2952a4 tempest-TestStampPattern-2010018532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:13:14 devstack sudo[101938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7396a42e-5071-4fe4-882b-7a989a918344 1073741824
Sep 07 18:13:14 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bddc710-8b8c-4f09-ad0c-df04b3b71193]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:13:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-372fcb61-8979-415e-9d86-9304ee2952a4 tempest-TestStampPattern-2010018532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:14 devstack sudo[101940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6
Sep 07 18:13:14 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:15 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7396a42e-5071-4fe4-882b-7a989a918344 1073741824" returned: 0 in 0.471s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7396a42e-5071-4fe4-882b-7a989a918344 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:15 devstack sudo[101951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7396a42e-5071-4fe4-882b-7a989a918344
Sep 07 18:13:15 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:15 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-372fcb61-8979-415e-9d86-9304ee2952a4 tempest-TestStampPattern-2010018532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6" returned: 0 in 0.614s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-372fcb61-8979-415e-9d86-9304ee2952a4 tempest-TestStampPattern-2010018532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.b7a87e89-3699-469e-a241-236cac0661f9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:15 devstack sudo[101957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.b7a87e89-3699-469e-a241-236cac0661f9
Sep 07 18:13:15 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:15 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7396a42e-5071-4fe4-882b-7a989a918344" returned: 0 in 0.303s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:13:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e3fbc46-abf5-4cfb-b4f7-951296ddaa21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7396a42e-5071-4fe4-882b-7a989a918344', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4c2ce9-9109-464c-9320-49963c480bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-d9d2585b-62ae-4288-81fc-4a3927969403 req-e2cb406a-4573-4129-8850-fdd9950fd028 tempest-TestInstancesWithCinderVolumes-601362612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-d9d2585b-62ae-4288-81fc-4a3927969403 req-e2cb406a-4573-4129-8850-fdd9950fd028 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:15 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Volume volume-7396a42e-5071-4fe4-882b-7a989a918344 (7396a42e-5071-4fe4-882b-7a989a918344): created successfully
Sep 07 18:13:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb4c2ce9-9109-464c-9320-49963c480bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Flow 'volume_create_manager' (b417784b-eac1-4216-b394-0ce7f0b629cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:13:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-d9d2585b-62ae-4288-81fc-4a3927969403 req-e2cb406a-4573-4129-8850-fdd9950fd028 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:15 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b7914fd2-3c16-4480-a61e-7a84001578bc tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Created volume successfully.
Sep 07 18:13:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-d9d2585b-62ae-4288-81fc-4a3927969403 req-e2cb406a-4573-4129-8850-fdd9950fd028 tempest-TestInstancesWithCinderVolumes-601362612 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d', 'name': 'volume-8d56b385-5c97-43ea-b97f-78df27d88947', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a85a4fde-3ea4-4f7b-a44c-6c1166d5bc09', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 07 18:13:15 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-d9d2585b-62ae-4288-81fc-4a3927969403 req-e2cb406a-4573-4129-8850-fdd9950fd028 tempest-TestInstancesWithCinderVolumes-601362612 None] attachment_update completed successfully.
Sep 07 18:13:15 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-372fcb61-8979-415e-9d86-9304ee2952a4 tempest-TestStampPattern-2010018532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.b7a87e89-3699-469e-a241-236cac0661f9" returned: 0 in 0.383s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-372fcb61-8979-415e-9d86-9304ee2952a4 tempest-TestStampPattern-2010018532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.b7a87e89-3699-469e-a241-236cac0661f9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:15 devstack sudo[101969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.b7a87e89-3699-469e-a241-236cac0661f9
Sep 07 18:13:15 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:15 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-372fcb61-8979-415e-9d86-9304ee2952a4 tempest-TestStampPattern-2010018532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6.b7a87e89-3699-469e-a241-236cac0661f9" returned: 0 in 0.283s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-372fcb61-8979-415e-9d86-9304ee2952a4 tempest-TestStampPattern-2010018532 None] Lock "cinder-quobyte-b7a87e89-3699-469e-a241-236cac0661f9" released by "_delete_snapshot" :: held 1.925s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-372fcb61-8979-415e-9d86-9304ee2952a4 tempest-TestStampPattern-2010018532 None] Lock "cinder-quobyte-00f6df7a-566d-4d64-905f-5c33fc65d3f6" released by "delete_snapshot" :: held 1.950s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:16 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-372fcb61-8979-415e-9d86-9304ee2952a4 tempest-TestStampPattern-2010018532 None] Created reservations ['6f0b02f3-9dbd-4c53-ba35-f84fb97b7687', '46eca131-ad2f-47f0-8b5d-4f7855aab2ac', '5e2559bd-7e69-40b8-a7bb-c744d21830b6', 'ddcdcd6d-104d-43b9-9649-3bf81719a635'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:13:16 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-372fcb61-8979-415e-9d86-9304ee2952a4 tempest-TestStampPattern-2010018532 None] Delete snapshot completed successfully.
Sep 07 18:13:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-372fcb61-8979-415e-9d86-9304ee2952a4 tempest-TestStampPattern-2010018532 None] Lock "cinder-b7a87e89-3699-469e-a241-236cac0661f9-delete_snapshot" released by "delete_snapshot" :: held 2.116s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-85a12d7a-d636-4997-bb1f-fa2940eca5ea tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-85a12d7a-d636-4997-bb1f-fa2940eca5ea tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-85a12d7a-d636-4997-bb1f-fa2940eca5ea tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-85a12d7a-d636-4997-bb1f-fa2940eca5ea tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-85a12d7a-d636-4997-bb1f-fa2940eca5ea tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-85a12d7a-d636-4997-bb1f-fa2940eca5ea tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:17 devstack sudo[101985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:13:17 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:17 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-85a12d7a-d636-4997-bb1f-fa2940eca5ea tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.347s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:17 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-85a12d7a-d636-4997-bb1f-fa2940eca5ea tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:13:17 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-85a12d7a-d636-4997-bb1f-fa2940eca5ea tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Retype volume completed successfully.
Sep 07 18:13:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b5a197aa-72e5-43c0-9e10-25c66f37f91a tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Acquiring lock "cinder-7396a42e-5071-4fe4-882b-7a989a918344-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b5a197aa-72e5-43c0-9e10-25c66f37f91a tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Lock "cinder-7396a42e-5071-4fe4-882b-7a989a918344-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b5a197aa-72e5-43c0-9e10-25c66f37f91a tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Acquiring lock "cinder-quobyte-7396a42e-5071-4fe4-882b-7a989a918344" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b5a197aa-72e5-43c0-9e10-25c66f37f91a tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Lock "cinder-quobyte-7396a42e-5071-4fe4-882b-7a989a918344" acquired by "delete_volume" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:18 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[867333fc-b4b4-4dab-b971-783688633237]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:13:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b5a197aa-72e5-43c0-9e10-25c66f37f91a tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7396a42e-5071-4fe4-882b-7a989a918344 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:18 devstack sudo[102011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7396a42e-5071-4fe4-882b-7a989a918344
Sep 07 18:13:18 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:19 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b5a197aa-72e5-43c0-9e10-25c66f37f91a tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7396a42e-5071-4fe4-882b-7a989a918344" returned: 0 in 0.528s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b5a197aa-72e5-43c0-9e10-25c66f37f91a tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7396a42e-5071-4fe4-882b-7a989a918344 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:19 devstack sudo[102021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7396a42e-5071-4fe4-882b-7a989a918344
Sep 07 18:13:19 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:19 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b5a197aa-72e5-43c0-9e10-25c66f37f91a tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7396a42e-5071-4fe4-882b-7a989a918344" returned: 0 in 0.304s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b5a197aa-72e5-43c0-9e10-25c66f37f91a tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Lock "cinder-quobyte-7396a42e-5071-4fe4-882b-7a989a918344" released by "delete_volume" :: held 0.903s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:19 devstack cinder-volume[87269]: WARNING cinder.quota [None req-b5a197aa-72e5-43c0-9e10-25c66f37f91a tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:13:19 devstack cinder-volume[87269]: WARNING cinder.quota [None req-b5a197aa-72e5-43c0-9e10-25c66f37f91a tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:13:19 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-b5a197aa-72e5-43c0-9e10-25c66f37f91a tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Created reservations ['814790d2-7317-4470-a77d-a06c22250aec', '2cb564e0-5c1e-40e7-a597-01637addb18a', '38ea2206-c267-405f-bba3-cf1e9e3decd3', '82bde50b-fb82-4827-901b-9d621c9f1062'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:13:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b5a197aa-72e5-43c0-9e10-25c66f37f91a tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b5a197aa-72e5-43c0-9e10-25c66f37f91a tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b5a197aa-72e5-43c0-9e10-25c66f37f91a tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b5a197aa-72e5-43c0-9e10-25c66f37f91a tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b5a197aa-72e5-43c0-9e10-25c66f37f91a tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b5a197aa-72e5-43c0-9e10-25c66f37f91a tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:19 devstack sudo[102034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:13:19 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:19 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b5a197aa-72e5-43c0-9e10-25c66f37f91a tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.289s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:19 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-b5a197aa-72e5-43c0-9e10-25c66f37f91a tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:13:19 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b5a197aa-72e5-43c0-9e10-25c66f37f91a tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Deleted volume successfully.
Sep 07 18:13:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b5a197aa-72e5-43c0-9e10-25c66f37f91a tempest-VolumeRetypeWithoutMigrationTest-1159787612 None] Lock "cinder-7396a42e-5071-4fe4-882b-7a989a918344-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-fbbfbed9-b85a-4519-a6ae-f8ff1bb6f133 tempest-TestStampPattern-2010018532 None] Acquiring lock "cinder-00f6df7a-566d-4d64-905f-5c33fc65d3f6-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-fbbfbed9-b85a-4519-a6ae-f8ff1bb6f133 tempest-TestStampPattern-2010018532 None] Lock "cinder-00f6df7a-566d-4d64-905f-5c33fc65d3f6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-fbbfbed9-b85a-4519-a6ae-f8ff1bb6f133 tempest-TestStampPattern-2010018532 None] Acquiring lock "cinder-quobyte-00f6df7a-566d-4d64-905f-5c33fc65d3f6" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-fbbfbed9-b85a-4519-a6ae-f8ff1bb6f133 tempest-TestStampPattern-2010018532 None] Lock "cinder-quobyte-00f6df7a-566d-4d64-905f-5c33fc65d3f6" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:20 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc83b208-67ff-4e7f-b76f-80243ed9e05f]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:13:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fbbfbed9-b85a-4519-a6ae-f8ff1bb6f133 tempest-TestStampPattern-2010018532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:20 devstack sudo[102048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6
Sep 07 18:13:20 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:20 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fbbfbed9-b85a-4519-a6ae-f8ff1bb6f133 tempest-TestStampPattern-2010018532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6" returned: 0 in 0.425s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fbbfbed9-b85a-4519-a6ae-f8ff1bb6f133 tempest-TestStampPattern-2010018532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:20 devstack sudo[102053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6
Sep 07 18:13:20 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:20 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-5b1519ca-5b20-4f36-ad51-b2db09a534da req-8a704a35-a39e-4928-9d93-cffd45c0067a tempest-TestInstancesWithCinderVolumes-601362612 None] Terminate volume connection completed successfully.
Sep 07 18:13:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-5b1519ca-5b20-4f36-ad51-b2db09a534da req-8a704a35-a39e-4928-9d93-cffd45c0067a tempest-TestInstancesWithCinderVolumes-601362612 None] Deleting attachment c82c005d-f647-4498-96d3-e0e9ec2dfaea. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 07 18:13:21 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fbbfbed9-b85a-4519-a6ae-f8ff1bb6f133 tempest-TestStampPattern-2010018532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-00f6df7a-566d-4d64-905f-5c33fc65d3f6" returned: 0 in 0.301s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-fbbfbed9-b85a-4519-a6ae-f8ff1bb6f133 tempest-TestStampPattern-2010018532 None] Lock "cinder-quobyte-00f6df7a-566d-4d64-905f-5c33fc65d3f6" released by "delete_volume" :: held 0.798s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:21 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-fbbfbed9-b85a-4519-a6ae-f8ff1bb6f133 tempest-TestStampPattern-2010018532 None] Created reservations ['7abe9826-6f8d-4ba1-a48d-cfc603a62fa4', '403e67f3-eee4-4a03-98dc-dcaa6e1c59a9', '5a7e7f1a-7e18-4354-9c19-93bbaf319a42', '6498c714-a0f2-4a80-9d83-77c581dddf63'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:13:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fbbfbed9-b85a-4519-a6ae-f8ff1bb6f133 tempest-TestStampPattern-2010018532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fbbfbed9-b85a-4519-a6ae-f8ff1bb6f133 tempest-TestStampPattern-2010018532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fbbfbed9-b85a-4519-a6ae-f8ff1bb6f133 tempest-TestStampPattern-2010018532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fbbfbed9-b85a-4519-a6ae-f8ff1bb6f133 tempest-TestStampPattern-2010018532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fbbfbed9-b85a-4519-a6ae-f8ff1bb6f133 tempest-TestStampPattern-2010018532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fbbfbed9-b85a-4519-a6ae-f8ff1bb6f133 tempest-TestStampPattern-2010018532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:21 devstack sudo[102058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:13:21 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:21 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fbbfbed9-b85a-4519-a6ae-f8ff1bb6f133 tempest-TestStampPattern-2010018532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.256s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:21 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-fbbfbed9-b85a-4519-a6ae-f8ff1bb6f133 tempest-TestStampPattern-2010018532 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:13:21 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-fbbfbed9-b85a-4519-a6ae-f8ff1bb6f133 tempest-TestStampPattern-2010018532 None] Deleted volume successfully.
Sep 07 18:13:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-fbbfbed9-b85a-4519-a6ae-f8ff1bb6f133 tempest-TestStampPattern-2010018532 None] Lock "cinder-00f6df7a-566d-4d64-905f-5c33fc65d3f6-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6bb1970b-db66-4404-abef-e5d07f1ecf10 tempest-TestInstancesWithCinderVolumes-601362612 None] Acquiring lock "cinder-0fcc75ec-20cd-47e0-8277-50ededb3dd29-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6bb1970b-db66-4404-abef-e5d07f1ecf10 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "cinder-0fcc75ec-20cd-47e0-8277-50ededb3dd29-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6bb1970b-db66-4404-abef-e5d07f1ecf10 tempest-TestInstancesWithCinderVolumes-601362612 None] Acquiring lock "cinder-quobyte-0fcc75ec-20cd-47e0-8277-50ededb3dd29" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6bb1970b-db66-4404-abef-e5d07f1ecf10 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "cinder-quobyte-0fcc75ec-20cd-47e0-8277-50ededb3dd29" acquired by "delete_volume" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:22 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0166995c-4de6-495c-8afa-8ae1f57c173f]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:13:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6bb1970b-db66-4404-abef-e5d07f1ecf10 tempest-TestInstancesWithCinderVolumes-601362612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-0fcc75ec-20cd-47e0-8277-50ededb3dd29 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:22 devstack sudo[102065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-0fcc75ec-20cd-47e0-8277-50ededb3dd29
Sep 07 18:13:22 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:22 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6bb1970b-db66-4404-abef-e5d07f1ecf10 tempest-TestInstancesWithCinderVolumes-601362612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-0fcc75ec-20cd-47e0-8277-50ededb3dd29" returned: 0 in 0.505s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6bb1970b-db66-4404-abef-e5d07f1ecf10 tempest-TestInstancesWithCinderVolumes-601362612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-0fcc75ec-20cd-47e0-8277-50ededb3dd29 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:22 devstack sudo[102071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-0fcc75ec-20cd-47e0-8277-50ededb3dd29
Sep 07 18:13:22 devstack sudo[102071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:22 devstack sudo[102071]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6bb1970b-db66-4404-abef-e5d07f1ecf10 tempest-TestInstancesWithCinderVolumes-601362612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-0fcc75ec-20cd-47e0-8277-50ededb3dd29" returned: 0 in 0.339s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6bb1970b-db66-4404-abef-e5d07f1ecf10 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "cinder-quobyte-0fcc75ec-20cd-47e0-8277-50ededb3dd29" released by "delete_volume" :: held 0.920s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:22 devstack cinder-volume[87269]: WARNING cinder.quota [None req-6bb1970b-db66-4404-abef-e5d07f1ecf10 tempest-TestInstancesWithCinderVolumes-601362612 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-490694058-1090349485 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-490694058-1090349485, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:13:22 devstack cinder-volume[87269]: WARNING cinder.quota [None req-6bb1970b-db66-4404-abef-e5d07f1ecf10 tempest-TestInstancesWithCinderVolumes-601362612 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-490694058-1090349485 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-490694058-1090349485, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:13:22 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-6bb1970b-db66-4404-abef-e5d07f1ecf10 tempest-TestInstancesWithCinderVolumes-601362612 None] Created reservations ['2f1f1439-9502-4109-9568-b76ea52ac033', 'f6973a61-a882-472b-ad8f-ee7537ad4de6', '03dc0e88-7a90-4319-9bca-6f74ecb1a96c', 'b678d6f7-586f-4c46-8055-8b32f89ba09f'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:13:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6bb1970b-db66-4404-abef-e5d07f1ecf10 tempest-TestInstancesWithCinderVolumes-601362612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6bb1970b-db66-4404-abef-e5d07f1ecf10 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6bb1970b-db66-4404-abef-e5d07f1ecf10 tempest-TestInstancesWithCinderVolumes-601362612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6bb1970b-db66-4404-abef-e5d07f1ecf10 tempest-TestInstancesWithCinderVolumes-601362612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6bb1970b-db66-4404-abef-e5d07f1ecf10 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6bb1970b-db66-4404-abef-e5d07f1ecf10 tempest-TestInstancesWithCinderVolumes-601362612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:23 devstack sudo[102074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:13:23 devstack sudo[102074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:23 devstack sudo[102074]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6bb1970b-db66-4404-abef-e5d07f1ecf10 tempest-TestInstancesWithCinderVolumes-601362612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.313s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:23 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-6bb1970b-db66-4404-abef-e5d07f1ecf10 tempest-TestInstancesWithCinderVolumes-601362612 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:13:23 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-6bb1970b-db66-4404-abef-e5d07f1ecf10 tempest-TestInstancesWithCinderVolumes-601362612 None] Deleted volume successfully.
Sep 07 18:13:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6bb1970b-db66-4404-abef-e5d07f1ecf10 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "cinder-0fcc75ec-20cd-47e0-8277-50ededb3dd29-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:25 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-156164f7-f006-4f07-b0bc-2213ce2a0d79 req-5d836f36-60e0-4f83-b856-9e8d43837519 tempest-TestInstancesWithCinderVolumes-601362612 None] Terminate volume connection completed successfully.
Sep 07 18:13:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-156164f7-f006-4f07-b0bc-2213ce2a0d79 req-5d836f36-60e0-4f83-b856-9e8d43837519 tempest-TestInstancesWithCinderVolumes-601362612 None] Deleting attachment a85a4fde-3ea4-4f7b-a44c-6c1166d5bc09. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 07 18:13:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3815ee17-3cdc-4984-954a-7686af3dcb04 tempest-TestInstancesWithCinderVolumes-601362612 None] Acquiring lock "cinder-8d56b385-5c97-43ea-b97f-78df27d88947-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3815ee17-3cdc-4984-954a-7686af3dcb04 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "cinder-8d56b385-5c97-43ea-b97f-78df27d88947-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3815ee17-3cdc-4984-954a-7686af3dcb04 tempest-TestInstancesWithCinderVolumes-601362612 None] Acquiring lock "cinder-quobyte-8d56b385-5c97-43ea-b97f-78df27d88947" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3815ee17-3cdc-4984-954a-7686af3dcb04 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "cinder-quobyte-8d56b385-5c97-43ea-b97f-78df27d88947" acquired by "delete_volume" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:26 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[314517d0-cfe3-4db1-bded-1947c9a72058]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:13:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3815ee17-3cdc-4984-954a-7686af3dcb04 tempest-TestInstancesWithCinderVolumes-601362612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8d56b385-5c97-43ea-b97f-78df27d88947 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:26 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:13:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Flow 'volume_create_manager' (d848c697-13e8-40f0-91fa-141f4b373d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:13:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6edb1b65-4cd0-4a09-8dbf-755c5905365b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6edb1b65-4cd0-4a09-8dbf-755c5905365b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-315797969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b6a757-69ec-4bca-9efc-62ee368afe85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ae9987a2eea4764b617d57088a43fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:13:27Z,use_quota=True,user_id='b453154c144542ed972c67c1f48d4a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e006ec00-88f2-4821-bf9a-8d26101146fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e006ec00-88f2-4821-bf9a-8d26101146fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5936ae-e2b0-44c3-9f26-dae853510e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5936ae-e2b0-44c3-9f26-dae853510e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67b6a757-69ec-4bca-9efc-62ee368afe85', 'volume_name': 'volume-67b6a757-69ec-4bca-9efc-62ee368afe85', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (785dd429-32f6-4466-b2da-83059897dc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:27 devstack sudo[102108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8d56b385-5c97-43ea-b97f-78df27d88947
Sep 07 18:13:27 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (785dd429-32f6-4466-b2da-83059897dc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb663b5b-ff1c-4b57-8da6-9257bd1d80ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:27 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Volume 67b6a757-69ec-4bca-9efc-62ee368afe85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67b6a757-69ec-4bca-9efc-62ee368afe85', 'volume_size': 1}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-315797969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67b6a757-69ec-4bca-9efc-62ee368afe85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ae9987a2eea4764b617d57088a43fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:13:27Z,use_quota=True,user_id='b453154c144542ed972c67c1f48d4a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Creating volume 67b6a757-69ec-4bca-9efc-62ee368afe85 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:13:27 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-67b6a757-69ec-4bca-9efc-62ee368afe85 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:27 devstack sudo[102110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-67b6a757-69ec-4bca-9efc-62ee368afe85 1073741824
Sep 07 18:13:27 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:27 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3815ee17-3cdc-4984-954a-7686af3dcb04 tempest-TestInstancesWithCinderVolumes-601362612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8d56b385-5c97-43ea-b97f-78df27d88947" returned: 0 in 0.397s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3815ee17-3cdc-4984-954a-7686af3dcb04 tempest-TestInstancesWithCinderVolumes-601362612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8d56b385-5c97-43ea-b97f-78df27d88947 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:27 devstack sudo[102118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8d56b385-5c97-43ea-b97f-78df27d88947
Sep 07 18:13:27 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:27 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-67b6a757-69ec-4bca-9efc-62ee368afe85 1073741824" returned: 0 in 0.523s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-67b6a757-69ec-4bca-9efc-62ee368afe85 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:27 devstack sudo[102123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-67b6a757-69ec-4bca-9efc-62ee368afe85
Sep 07 18:13:27 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:27 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3815ee17-3cdc-4984-954a-7686af3dcb04 tempest-TestInstancesWithCinderVolumes-601362612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8d56b385-5c97-43ea-b97f-78df27d88947" returned: 0 in 0.354s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3815ee17-3cdc-4984-954a-7686af3dcb04 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "cinder-quobyte-8d56b385-5c97-43ea-b97f-78df27d88947" released by "delete_volume" :: held 0.816s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:27 devstack cinder-volume[87269]: WARNING cinder.quota [None req-3815ee17-3cdc-4984-954a-7686af3dcb04 tempest-TestInstancesWithCinderVolumes-601362612 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-41990556-1215510391 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-41990556-1215510391, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:13:27 devstack cinder-volume[87269]: WARNING cinder.quota [None req-3815ee17-3cdc-4984-954a-7686af3dcb04 tempest-TestInstancesWithCinderVolumes-601362612 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-41990556-1215510391 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-41990556-1215510391, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-3815ee17-3cdc-4984-954a-7686af3dcb04 tempest-TestInstancesWithCinderVolumes-601362612 None] Created reservations ['fcc45ec2-3b46-477e-8090-18832ca6b039', '7541a656-5877-484d-8db0-7e3bb93c0458', '1a27cad0-b618-4ee1-a35e-dc583073d656', '24e8a085-3811-4769-81b3-f892d53671cb'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3815ee17-3cdc-4984-954a-7686af3dcb04 tempest-TestInstancesWithCinderVolumes-601362612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3815ee17-3cdc-4984-954a-7686af3dcb04 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3815ee17-3cdc-4984-954a-7686af3dcb04 tempest-TestInstancesWithCinderVolumes-601362612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3815ee17-3cdc-4984-954a-7686af3dcb04 tempest-TestInstancesWithCinderVolumes-601362612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3815ee17-3cdc-4984-954a-7686af3dcb04 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3815ee17-3cdc-4984-954a-7686af3dcb04 tempest-TestInstancesWithCinderVolumes-601362612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:27 devstack sudo[102127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:13:27 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:27 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-67b6a757-69ec-4bca-9efc-62ee368afe85" returned: 0 in 0.370s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:13:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb663b5b-ff1c-4b57-8da6-9257bd1d80ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67b6a757-69ec-4bca-9efc-62ee368afe85', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4360a122-5eb7-43bb-9ae2-f65cb524b9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:28 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Volume volume-67b6a757-69ec-4bca-9efc-62ee368afe85 (67b6a757-69ec-4bca-9efc-62ee368afe85): created successfully
Sep 07 18:13:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4360a122-5eb7-43bb-9ae2-f65cb524b9a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:28 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Flow 'volume_create_manager' (d848c697-13e8-40f0-91fa-141f4b373d3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:13:28 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f42a527c-bb5a-4fcd-993a-563e55789266 tempest-VolumesServicesTestJSON-1383991174 None] Created volume successfully.
Sep 07 18:13:28 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3815ee17-3cdc-4984-954a-7686af3dcb04 tempest-TestInstancesWithCinderVolumes-601362612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.311s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:28 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-3815ee17-3cdc-4984-954a-7686af3dcb04 tempest-TestInstancesWithCinderVolumes-601362612 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:13:28 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3815ee17-3cdc-4984-954a-7686af3dcb04 tempest-TestInstancesWithCinderVolumes-601362612 None] Deleted volume successfully.
Sep 07 18:13:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3815ee17-3cdc-4984-954a-7686af3dcb04 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "cinder-8d56b385-5c97-43ea-b97f-78df27d88947-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3d6ac990-4722-4241-a211-67587db6b479 tempest-VolumesServicesTestJSON-1383991174 None] Acquiring lock "cinder-67b6a757-69ec-4bca-9efc-62ee368afe85-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3d6ac990-4722-4241-a211-67587db6b479 tempest-VolumesServicesTestJSON-1383991174 None] Lock "cinder-67b6a757-69ec-4bca-9efc-62ee368afe85-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3d6ac990-4722-4241-a211-67587db6b479 tempest-VolumesServicesTestJSON-1383991174 None] Acquiring lock "cinder-quobyte-67b6a757-69ec-4bca-9efc-62ee368afe85" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3d6ac990-4722-4241-a211-67587db6b479 tempest-VolumesServicesTestJSON-1383991174 None] Lock "cinder-quobyte-67b6a757-69ec-4bca-9efc-62ee368afe85" acquired by "delete_volume" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:29 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[566d3ed1-c524-4049-887e-2106c036d002]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:13:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3d6ac990-4722-4241-a211-67587db6b479 tempest-VolumesServicesTestJSON-1383991174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-67b6a757-69ec-4bca-9efc-62ee368afe85 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:29 devstack sudo[102131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-67b6a757-69ec-4bca-9efc-62ee368afe85
Sep 07 18:13:29 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:29 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3d6ac990-4722-4241-a211-67587db6b479 tempest-VolumesServicesTestJSON-1383991174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-67b6a757-69ec-4bca-9efc-62ee368afe85" returned: 0 in 0.485s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3d6ac990-4722-4241-a211-67587db6b479 tempest-VolumesServicesTestJSON-1383991174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-67b6a757-69ec-4bca-9efc-62ee368afe85 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:29 devstack sudo[102139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-67b6a757-69ec-4bca-9efc-62ee368afe85
Sep 07 18:13:29 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:30 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3d6ac990-4722-4241-a211-67587db6b479 tempest-VolumesServicesTestJSON-1383991174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-67b6a757-69ec-4bca-9efc-62ee368afe85" returned: 0 in 0.355s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3d6ac990-4722-4241-a211-67587db6b479 tempest-VolumesServicesTestJSON-1383991174 None] Lock "cinder-quobyte-67b6a757-69ec-4bca-9efc-62ee368afe85" released by "delete_volume" :: held 0.891s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:30 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-3d6ac990-4722-4241-a211-67587db6b479 tempest-VolumesServicesTestJSON-1383991174 None] Created reservations ['00552012-3672-4412-ab0e-83986454c847', '0a1e59c3-3e05-45db-a1a5-132f657d8cb7', '88b3f7e8-95fc-461c-b8bc-fb61e0293577', 'bb1d1d05-b702-4dad-85f2-514324d2cc77'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:13:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3d6ac990-4722-4241-a211-67587db6b479 tempest-VolumesServicesTestJSON-1383991174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3d6ac990-4722-4241-a211-67587db6b479 tempest-VolumesServicesTestJSON-1383991174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3d6ac990-4722-4241-a211-67587db6b479 tempest-VolumesServicesTestJSON-1383991174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3d6ac990-4722-4241-a211-67587db6b479 tempest-VolumesServicesTestJSON-1383991174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3d6ac990-4722-4241-a211-67587db6b479 tempest-VolumesServicesTestJSON-1383991174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3d6ac990-4722-4241-a211-67587db6b479 tempest-VolumesServicesTestJSON-1383991174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:30 devstack sudo[102161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:13:30 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:30 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3d6ac990-4722-4241-a211-67587db6b479 tempest-VolumesServicesTestJSON-1383991174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.312s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:30 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-3d6ac990-4722-4241-a211-67587db6b479 tempest-VolumesServicesTestJSON-1383991174 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:13:30 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3d6ac990-4722-4241-a211-67587db6b479 tempest-VolumesServicesTestJSON-1383991174 None] Deleted volume successfully.
Sep 07 18:13:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3d6ac990-4722-4241-a211-67587db6b479 tempest-VolumesServicesTestJSON-1383991174 None] Lock "cinder-67b6a757-69ec-4bca-9efc-62ee368afe85-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:31 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-27cfe839-94cd-47c8-a754-830c331f1d3e req-0b780aba-1509-40f4-a7bd-e3dc4baa6209 tempest-TestInstancesWithCinderVolumes-601362612 None] Terminate volume connection completed successfully.
Sep 07 18:13:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-27cfe839-94cd-47c8-a754-830c331f1d3e req-0b780aba-1509-40f4-a7bd-e3dc4baa6209 tempest-TestInstancesWithCinderVolumes-601362612 None] Deleting attachment beaa575b-7845-4013-8d84-9273eca30bfa. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 07 18:13:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d0b5cabe-2c9b-4281-9c27-215c51eb2576 tempest-TestInstancesWithCinderVolumes-601362612 None] Acquiring lock "cinder-28d785ce-cdd7-4aea-a838-2baad8895863-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d0b5cabe-2c9b-4281-9c27-215c51eb2576 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "cinder-28d785ce-cdd7-4aea-a838-2baad8895863-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d0b5cabe-2c9b-4281-9c27-215c51eb2576 tempest-TestInstancesWithCinderVolumes-601362612 None] Acquiring lock "cinder-quobyte-28d785ce-cdd7-4aea-a838-2baad8895863" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d0b5cabe-2c9b-4281-9c27-215c51eb2576 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "cinder-quobyte-28d785ce-cdd7-4aea-a838-2baad8895863" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:33 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9ac17c-6ab6-4c55-8087-3d2d298e032c]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:13:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d0b5cabe-2c9b-4281-9c27-215c51eb2576 tempest-TestInstancesWithCinderVolumes-601362612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28d785ce-cdd7-4aea-a838-2baad8895863 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:33 devstack sudo[102168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28d785ce-cdd7-4aea-a838-2baad8895863
Sep 07 18:13:33 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:33 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d0b5cabe-2c9b-4281-9c27-215c51eb2576 tempest-TestInstancesWithCinderVolumes-601362612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28d785ce-cdd7-4aea-a838-2baad8895863" returned: 0 in 0.444s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d0b5cabe-2c9b-4281-9c27-215c51eb2576 tempest-TestInstancesWithCinderVolumes-601362612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28d785ce-cdd7-4aea-a838-2baad8895863 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:33 devstack sudo[102174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28d785ce-cdd7-4aea-a838-2baad8895863
Sep 07 18:13:33 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:33 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d0b5cabe-2c9b-4281-9c27-215c51eb2576 tempest-TestInstancesWithCinderVolumes-601362612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28d785ce-cdd7-4aea-a838-2baad8895863" returned: 0 in 0.289s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d0b5cabe-2c9b-4281-9c27-215c51eb2576 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "cinder-quobyte-28d785ce-cdd7-4aea-a838-2baad8895863" released by "delete_volume" :: held 0.793s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:33 devstack cinder-volume[87269]: WARNING cinder.quota [None req-d0b5cabe-2c9b-4281-9c27-215c51eb2576 tempest-TestInstancesWithCinderVolumes-601362612 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1944575417-555732852 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1944575417-555732852, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:13:33 devstack cinder-volume[87269]: WARNING cinder.quota [None req-d0b5cabe-2c9b-4281-9c27-215c51eb2576 tempest-TestInstancesWithCinderVolumes-601362612 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1944575417-555732852 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1944575417-555732852, it is now deprecated. Please use the default quota class for default quota.
Sep 07 18:13:33 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-d0b5cabe-2c9b-4281-9c27-215c51eb2576 tempest-TestInstancesWithCinderVolumes-601362612 None] Created reservations ['34406251-1283-4a65-b28f-405eff84ae9f', 'e6080a37-fc96-4275-b53e-81cd7819aa31', '3f678f30-3a59-4429-99e7-888e4a99800e', 'e8b296e4-dd23-45e2-99cb-2c2f54a7ed92'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:13:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d0b5cabe-2c9b-4281-9c27-215c51eb2576 tempest-TestInstancesWithCinderVolumes-601362612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d0b5cabe-2c9b-4281-9c27-215c51eb2576 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d0b5cabe-2c9b-4281-9c27-215c51eb2576 tempest-TestInstancesWithCinderVolumes-601362612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d0b5cabe-2c9b-4281-9c27-215c51eb2576 tempest-TestInstancesWithCinderVolumes-601362612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d0b5cabe-2c9b-4281-9c27-215c51eb2576 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d0b5cabe-2c9b-4281-9c27-215c51eb2576 tempest-TestInstancesWithCinderVolumes-601362612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:34 devstack sudo[102177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:13:34 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:34 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d0b5cabe-2c9b-4281-9c27-215c51eb2576 tempest-TestInstancesWithCinderVolumes-601362612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.322s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:34 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-d0b5cabe-2c9b-4281-9c27-215c51eb2576 tempest-TestInstancesWithCinderVolumes-601362612 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:13:34 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d0b5cabe-2c9b-4281-9c27-215c51eb2576 tempest-TestInstancesWithCinderVolumes-601362612 None] Deleted volume successfully.
Sep 07 18:13:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d0b5cabe-2c9b-4281-9c27-215c51eb2576 tempest-TestInstancesWithCinderVolumes-601362612 None] Lock "cinder-28d785ce-cdd7-4aea-a838-2baad8895863-delete_volume" released by "delete_volume" :: held 1.445s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:37 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:13:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Flow 'volume_create_manager' (d4653458-da2b-403b-98fb-20913b47190a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:13:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07f9ffb-7fc2-4ffe-acc8-b448e66f2d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07f9ffb-7fc2-4ffe-acc8-b448e66f2d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-541051441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44341d591001405bb7a528daf155889d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:13:37Z,use_quota=True,user_id='bf0dd4d5750e45e7a8069b740c82ec53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a745bb6-0559-444e-83de-a807461b96df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a745bb6-0559-444e-83de-a807461b96df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea197c2-4a89-4382-8e51-227d6a35f118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea197c2-4a89-4382-8e51-227d6a35f118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1', 'volume_name': 'volume-e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a87d2d24-dcea-43d0-a01c-99779acd8f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a87d2d24-dcea-43d0-a01c-99779acd8f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af69781-7dd8-4323-832b-8debf23495a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:37 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Volume e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1', 'volume_size': 1}
Sep 07 18:13:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-541051441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44341d591001405bb7a528daf155889d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:13:37Z,use_quota=True,user_id='bf0dd4d5750e45e7a8069b740c82ec53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:13:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Creating volume e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:13:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:13:37 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:13:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:37 devstack sudo[102183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1 1073741824
Sep 07 18:13:37 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:37 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:13:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Flow 'volume_create_manager' (c37e2fcf-0538-4b82-84a6-dc1292769cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0749bb35-e7dc-4d84-a9e6-029bc9ab4853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0749bb35-e7dc-4d84-a9e6-029bc9ab4853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2089580637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aecd1104-590c-4ef6-ae23-4bc58544e099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44341d591001405bb7a528daf155889d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:13:38Z,use_quota=True,user_id='bf0dd4d5750e45e7a8069b740c82ec53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5f66ae-ee8c-4c40-a739-f9551369b374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5f66ae-ee8c-4c40-a739-f9551369b374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a3d4477-1414-48a8-8d37-9dfc4ad612f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a3d4477-1414-48a8-8d37-9dfc4ad612f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aecd1104-590c-4ef6-ae23-4bc58544e099', 'volume_name': 'volume-aecd1104-590c-4ef6-ae23-4bc58544e099', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485528d9-1b62-4b0b-a7f7-70a06202f323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (485528d9-1b62-4b0b-a7f7-70a06202f323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d99857-d8b9-4073-b543-b8c2b0144f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:38 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Volume aecd1104-590c-4ef6-ae23-4bc58544e099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aecd1104-590c-4ef6-ae23-4bc58544e099', 'volume_size': 1}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:38 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1 1073741824" returned: 0 in 0.714s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:38 devstack sudo[102191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1
Sep 07 18:13:38 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:13:38 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Flow 'volume_create_manager' (79edaffc-28fd-4f8b-a3e4-a3ef0766684d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010ac2f1-4fd8-46dd-91f9-53b8356cfcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1" returned: 0 in 0.348s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.400s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2089580637',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aecd1104-590c-4ef6-ae23-4bc58544e099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44341d591001405bb7a528daf155889d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:13:38Z,use_quota=True,user_id='bf0dd4d5750e45e7a8069b740c82ec53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Creating volume aecd1104-590c-4ef6-ae23-4bc58544e099 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:13:38 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aecd1104-590c-4ef6-ae23-4bc58544e099 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010ac2f1-4fd8-46dd-91f9-53b8356cfcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-184216103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=888e67a3-212d-4830-8a90-b5da48a12232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44341d591001405bb7a528daf155889d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:13:38Z,use_quota=True,user_id='bf0dd4d5750e45e7a8069b740c82ec53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec94ed91-d930-4a7a-beca-74cbfcf81b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:38 devstack sudo[102194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aecd1104-590c-4ef6-ae23-4bc58544e099 1073741824
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec94ed91-d930-4a7a-beca-74cbfcf81b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:38 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d94cf10d-2ef7-4842-b576-769a73a660f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d94cf10d-2ef7-4842-b576-769a73a660f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '888e67a3-212d-4830-8a90-b5da48a12232', 'volume_name': 'volume-888e67a3-212d-4830-8a90-b5da48a12232', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5dcea5e-2420-4e00-b7fd-01a304212461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5dcea5e-2420-4e00-b7fd-01a304212461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7abaff93-4c6f-4ad5-8951-50657a9dfcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:38 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Volume 888e67a3-212d-4830-8a90-b5da48a12232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-888e67a3-212d-4830-8a90-b5da48a12232', 'volume_size': 1}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af69781-7dd8-4323-832b-8debf23495a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (191d6b9c-eaf8-4e36-9d32-3260ab6d1284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:38 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Volume volume-e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1 (e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1): created successfully
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (191d6b9c-eaf8-4e36-9d32-3260ab6d1284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Flow 'volume_create_manager' (d4653458-da2b-403b-98fb-20913b47190a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:13:38 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-cc1e396e-bc56-4cfd-a569-57365cda5480 tempest-CreateVolumesFromImageTest-2079471042 None] Created volume successfully.
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Flow 'volume_create_manager' (1f813dcf-ea11-40a6-aa8a-ed2d31921a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35060407-c967-456b-96a6-3504a9b84716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35060407-c967-456b-96a6-3504a9b84716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1447225102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11061d83-c99d-4c18-8e31-82bebdb0c117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44341d591001405bb7a528daf155889d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:13:39Z,use_quota=True,user_id='bf0dd4d5750e45e7a8069b740c82ec53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:39 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d939779a-8899-467b-8efa-0bc63ebf65e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d939779a-8899-467b-8efa-0bc63ebf65e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df37cc41-3afb-4309-8736-0ea62ddad235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df37cc41-3afb-4309-8736-0ea62ddad235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11061d83-c99d-4c18-8e31-82bebdb0c117', 'volume_name': 'volume-11061d83-c99d-4c18-8e31-82bebdb0c117', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e6e422-b21d-4fd8-b5ff-cc3bd54622d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e6e422-b21d-4fd8-b5ff-cc3bd54622d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28536a71-3ba5-4049-a730-09e3dea5fafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:39 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Volume 11061d83-c99d-4c18-8e31-82bebdb0c117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11061d83-c99d-4c18-8e31-82bebdb0c117', 'volume_size': 1}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aecd1104-590c-4ef6-ae23-4bc58544e099 1073741824" returned: 0 in 0.774s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aecd1104-590c-4ef6-ae23-4bc58544e099 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:39 devstack sudo[102200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aecd1104-590c-4ef6-ae23-4bc58544e099
Sep 07 18:13:39 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:39 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aecd1104-590c-4ef6-ae23-4bc58544e099" returned: 0 in 0.273s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.038s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-184216103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=888e67a3-212d-4830-8a90-b5da48a12232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44341d591001405bb7a528daf155889d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:13:38Z,use_quota=True,user_id='bf0dd4d5750e45e7a8069b740c82ec53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Creating volume 888e67a3-212d-4830-8a90-b5da48a12232 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:13:39 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-888e67a3-212d-4830-8a90-b5da48a12232 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:13:39 devstack sudo[102204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-888e67a3-212d-4830-8a90-b5da48a12232 1073741824
Sep 07 18:13:39 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Flow 'volume_create_manager' (d4500c1b-42f5-4d11-8e6b-9d45d2b53278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99efae33-1f9a-4194-8126-887b1e84c4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69d99857-d8b9-4073-b543-b8c2b0144f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aecd1104-590c-4ef6-ae23-4bc58544e099', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441f6cf0-fbaf-4012-9ef4-173e4d64a5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99efae33-1f9a-4194-8126-887b1e84c4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1157548692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5811650-3ba3-4403-8ad8-33464380b3b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44341d591001405bb7a528daf155889d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:13:40Z,use_quota=True,user_id='bf0dd4d5750e45e7a8069b740c82ec53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fca6c81-5e04-40e0-8bf6-a3d052f06da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fca6c81-5e04-40e0-8bf6-a3d052f06da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b384d03d-41c1-4b6a-96f5-bbd3108d0cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b384d03d-41c1-4b6a-96f5-bbd3108d0cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5811650-3ba3-4403-8ad8-33464380b3b9', 'volume_name': 'volume-a5811650-3ba3-4403-8ad8-33464380b3b9', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ad18b64-49cc-4707-9aa7-5d0281f42639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ad18b64-49cc-4707-9aa7-5d0281f42639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea99a25-f433-41c2-9744-3fcb35013fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:39 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Volume a5811650-3ba3-4403-8ad8-33464380b3b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5811650-3ba3-4403-8ad8-33464380b3b9', 'volume_size': 1}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:39 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Volume volume-aecd1104-590c-4ef6-ae23-4bc58544e099 (aecd1104-590c-4ef6-ae23-4bc58544e099): created successfully
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (441f6cf0-fbaf-4012-9ef4-173e4d64a5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Flow 'volume_create_manager' (c37e2fcf-0538-4b82-84a6-dc1292769cfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Flow 'volume_create_manager' (a75a1a00-1b6e-4e3d-9d9d-6c0c77f07bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d99a33-e92c-491b-9070-f7049af7da4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:39 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d8610dec-7148-494a-a94a-d66f93505b84 tempest-CreateVolumesFromImageTest-2079471042 None] Created volume successfully.
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3d99a33-e92c-491b-9070-f7049af7da4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-928580044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a775eea3-091e-48a9-a14e-419e69be965d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0894234cd9754dff9365de486d36445b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:13:40Z,use_quota=True,user_id='8efb5425cd0642d9a6ca2bd1cc036717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b21ba1-63a5-41ee-96d0-d75eeaeccd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7b21ba1-63a5-41ee-96d0-d75eeaeccd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d044eac4-3c25-4645-a99e-67e61166cdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d044eac4-3c25-4645-a99e-67e61166cdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a775eea3-091e-48a9-a14e-419e69be965d', 'volume_name': 'volume-a775eea3-091e-48a9-a14e-419e69be965d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197a1256-2d70-420f-965b-d8d3fc17be96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197a1256-2d70-420f-965b-d8d3fc17be96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674f77d0-7ae6-4a50-b60a-01705ac2df12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:39 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Volume a775eea3-091e-48a9-a14e-419e69be965d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a775eea3-091e-48a9-a14e-419e69be965d', 'volume_size': 1}
Sep 07 18:13:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:40 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-888e67a3-212d-4830-8a90-b5da48a12232 1073741824" returned: 0 in 0.520s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-888e67a3-212d-4830-8a90-b5da48a12232 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:40 devstack sudo[102210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-888e67a3-212d-4830-8a90-b5da48a12232
Sep 07 18:13:40 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:40 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-888e67a3-212d-4830-8a90-b5da48a12232" returned: 0 in 0.285s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:13:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.185s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1447225102',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11061d83-c99d-4c18-8e31-82bebdb0c117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44341d591001405bb7a528daf155889d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:13:39Z,use_quota=True,user_id='bf0dd4d5750e45e7a8069b740c82ec53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:13:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Creating volume 11061d83-c99d-4c18-8e31-82bebdb0c117 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:13:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:13:40 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:13:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-11061d83-c99d-4c18-8e31-82bebdb0c117 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:40 devstack sudo[102213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-11061d83-c99d-4c18-8e31-82bebdb0c117 1073741824
Sep 07 18:13:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7abaff93-4c6f-4ad5-8951-50657a9dfcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-888e67a3-212d-4830-8a90-b5da48a12232', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:40 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efc0ba3-d71c-43ad-a76f-c1915b3acafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:40 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Volume volume-888e67a3-212d-4830-8a90-b5da48a12232 (888e67a3-212d-4830-8a90-b5da48a12232): created successfully
Sep 07 18:13:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efc0ba3-d71c-43ad-a76f-c1915b3acafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Flow 'volume_create_manager' (79edaffc-28fd-4f8b-a3e4-a3ef0766684d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:13:40 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3b911dde-c56c-44e1-a4e7-f74fd67b1c26 tempest-CreateVolumesFromImageTest-2079471042 None] Created volume successfully.
Sep 07 18:13:40 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-11061d83-c99d-4c18-8e31-82bebdb0c117 1073741824" returned: 0 in 0.450s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-11061d83-c99d-4c18-8e31-82bebdb0c117 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:41 devstack sudo[102219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-11061d83-c99d-4c18-8e31-82bebdb0c117
Sep 07 18:13:41 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:41 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-11061d83-c99d-4c18-8e31-82bebdb0c117" returned: 0 in 0.242s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:13:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.447s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1157548692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5811650-3ba3-4403-8ad8-33464380b3b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44341d591001405bb7a528daf155889d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:13:40Z,use_quota=True,user_id='bf0dd4d5750e45e7a8069b740c82ec53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:13:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Creating volume a5811650-3ba3-4403-8ad8-33464380b3b9 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:13:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:13:41 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:13:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a5811650-3ba3-4403-8ad8-33464380b3b9 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28536a71-3ba5-4049-a730-09e3dea5fafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11061d83-c99d-4c18-8e31-82bebdb0c117', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:41 devstack sudo[102222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a5811650-3ba3-4403-8ad8-33464380b3b9 1073741824
Sep 07 18:13:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54aaa34-58fa-466f-a956-eb1813c12a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:41 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:41 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Volume volume-11061d83-c99d-4c18-8e31-82bebdb0c117 (11061d83-c99d-4c18-8e31-82bebdb0c117): created successfully
Sep 07 18:13:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54aaa34-58fa-466f-a956-eb1813c12a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:41 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Flow 'volume_create_manager' (1f813dcf-ea11-40a6-aa8a-ed2d31921a63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:13:41 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e8c70303-4600-45ff-8feb-c58eac50353c tempest-CreateVolumesFromImageTest-2079471042 None] Created volume successfully.
Sep 07 18:13:41 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a5811650-3ba3-4403-8ad8-33464380b3b9 1073741824" returned: 0 in 0.504s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a5811650-3ba3-4403-8ad8-33464380b3b9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:41 devstack sudo[102229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a5811650-3ba3-4403-8ad8-33464380b3b9
Sep 07 18:13:41 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:42 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a5811650-3ba3-4403-8ad8-33464380b3b9" returned: 0 in 0.242s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.127s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-928580044',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a775eea3-091e-48a9-a14e-419e69be965d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0894234cd9754dff9365de486d36445b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:13:40Z,use_quota=True,user_id='8efb5425cd0642d9a6ca2bd1cc036717',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Creating volume a775eea3-091e-48a9-a14e-419e69be965d {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:13:42 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea99a25-f433-41c2-9744-3fcb35013fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5811650-3ba3-4403-8ad8-33464380b3b9', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:42 devstack sudo[102232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d 1073741824
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e268cc-cfaf-41e1-b5e4-665f88fff359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:42 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:42 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Volume volume-a5811650-3ba3-4403-8ad8-33464380b3b9 (a5811650-3ba3-4403-8ad8-33464380b3b9): created successfully
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64e268cc-cfaf-41e1-b5e4-665f88fff359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Flow 'volume_create_manager' (d4500c1b-42f5-4d11-8e6b-9d45d2b53278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:13:42 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-aac50476-e25a-4e42-8f34-3b1d2cafe2d1 tempest-CreateVolumesFromImageTest-2079471042 None] Created volume successfully.
Sep 07 18:13:42 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d 1073741824" returned: 0 in 0.444s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:42 devstack sudo[102238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d
Sep 07 18:13:42 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:42 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d" returned: 0 in 0.297s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674f77d0-7ae6-4a50-b60a-01705ac2df12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a775eea3-091e-48a9-a14e-419e69be965d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b276532-09e5-498e-b1e2-d67dbe1ce88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:42 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Volume volume-a775eea3-091e-48a9-a14e-419e69be965d (a775eea3-091e-48a9-a14e-419e69be965d): created successfully
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b276532-09e5-498e-b1e2-d67dbe1ce88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Flow 'volume_create_manager' (a75a1a00-1b6e-4e3d-9d9d-6c0c77f07bf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:13:42 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4059c0de-fce3-4391-8908-472d2164346d tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Created volume successfully.
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f218a0ec-0ea1-4975-b1bf-38c87cc98a5d tempest-CreateVolumesFromImageTest-2079471042 None] Acquiring lock "cinder-a5811650-3ba3-4403-8ad8-33464380b3b9-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f218a0ec-0ea1-4975-b1bf-38c87cc98a5d tempest-CreateVolumesFromImageTest-2079471042 None] Lock "cinder-a5811650-3ba3-4403-8ad8-33464380b3b9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f218a0ec-0ea1-4975-b1bf-38c87cc98a5d tempest-CreateVolumesFromImageTest-2079471042 None] Acquiring lock "cinder-quobyte-a5811650-3ba3-4403-8ad8-33464380b3b9" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f218a0ec-0ea1-4975-b1bf-38c87cc98a5d tempest-CreateVolumesFromImageTest-2079471042 None] Lock "cinder-quobyte-a5811650-3ba3-4403-8ad8-33464380b3b9" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:43 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d42f63-81a0-4bc8-ad4c-fae7475184c0]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:13:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f218a0ec-0ea1-4975-b1bf-38c87cc98a5d tempest-CreateVolumesFromImageTest-2079471042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a5811650-3ba3-4403-8ad8-33464380b3b9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:43 devstack sudo[102241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a5811650-3ba3-4403-8ad8-33464380b3b9
Sep 07 18:13:43 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:43 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f218a0ec-0ea1-4975-b1bf-38c87cc98a5d tempest-CreateVolumesFromImageTest-2079471042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a5811650-3ba3-4403-8ad8-33464380b3b9" returned: 0 in 0.348s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f218a0ec-0ea1-4975-b1bf-38c87cc98a5d tempest-CreateVolumesFromImageTest-2079471042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a5811650-3ba3-4403-8ad8-33464380b3b9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:43 devstack sudo[102246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a5811650-3ba3-4403-8ad8-33464380b3b9
Sep 07 18:13:43 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:43 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f218a0ec-0ea1-4975-b1bf-38c87cc98a5d tempest-CreateVolumesFromImageTest-2079471042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a5811650-3ba3-4403-8ad8-33464380b3b9" returned: 0 in 0.285s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f218a0ec-0ea1-4975-b1bf-38c87cc98a5d tempest-CreateVolumesFromImageTest-2079471042 None] Lock "cinder-quobyte-a5811650-3ba3-4403-8ad8-33464380b3b9" released by "delete_volume" :: held 0.678s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:43 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-f218a0ec-0ea1-4975-b1bf-38c87cc98a5d tempest-CreateVolumesFromImageTest-2079471042 None] Created reservations ['9011c30e-63ef-4ee1-8ee5-a9c46be0d095', '9e4233e0-6427-4f29-8821-1ec0ea8df47f', '2200dc01-d562-44b3-8140-a7ec1fdbe74e', '7be683b5-a951-4354-80b6-5f9654113710'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:13:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f218a0ec-0ea1-4975-b1bf-38c87cc98a5d tempest-CreateVolumesFromImageTest-2079471042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f218a0ec-0ea1-4975-b1bf-38c87cc98a5d tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f218a0ec-0ea1-4975-b1bf-38c87cc98a5d tempest-CreateVolumesFromImageTest-2079471042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f218a0ec-0ea1-4975-b1bf-38c87cc98a5d tempest-CreateVolumesFromImageTest-2079471042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f218a0ec-0ea1-4975-b1bf-38c87cc98a5d tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f218a0ec-0ea1-4975-b1bf-38c87cc98a5d tempest-CreateVolumesFromImageTest-2079471042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:43 devstack sudo[102249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:13:43 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-61efb860-e6b4-4b91-938f-7863dbdcc5e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-61efb860-e6b4-4b91-938f-7863dbdcc5e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-61efb860-e6b4-4b91-938f-7863dbdcc5e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Creating offline snapshot b59d16b1-80aa-42ff-8d70-a5e8ba2bd986 of volume a775eea3-091e-48a9-a14e-419e69be965d {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:13:44 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[074ad240-bfda-4711-b123-339464eb5127]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:13:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-61efb860-e6b4-4b91-938f-7863dbdcc5e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:44 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f218a0ec-0ea1-4975-b1bf-38c87cc98a5d tempest-CreateVolumesFromImageTest-2079471042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.292s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:44 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f218a0ec-0ea1-4975-b1bf-38c87cc98a5d tempest-CreateVolumesFromImageTest-2079471042 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:13:44 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f218a0ec-0ea1-4975-b1bf-38c87cc98a5d tempest-CreateVolumesFromImageTest-2079471042 None] Deleted volume successfully.
Sep 07 18:13:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5aefd3f6-a6e3-466c-a6b8-ec3f3803a73f tempest-CreateVolumesFromImageTest-2079471042 None] Acquiring lock "cinder-11061d83-c99d-4c18-8e31-82bebdb0c117-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f218a0ec-0ea1-4975-b1bf-38c87cc98a5d tempest-CreateVolumesFromImageTest-2079471042 None] Lock "cinder-a5811650-3ba3-4403-8ad8-33464380b3b9-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5aefd3f6-a6e3-466c-a6b8-ec3f3803a73f tempest-CreateVolumesFromImageTest-2079471042 None] Lock "cinder-11061d83-c99d-4c18-8e31-82bebdb0c117-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:44 devstack sudo[102252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d
Sep 07 18:13:44 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5aefd3f6-a6e3-466c-a6b8-ec3f3803a73f tempest-CreateVolumesFromImageTest-2079471042 None] Acquiring lock "cinder-quobyte-11061d83-c99d-4c18-8e31-82bebdb0c117" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5aefd3f6-a6e3-466c-a6b8-ec3f3803a73f tempest-CreateVolumesFromImageTest-2079471042 None] Lock "cinder-quobyte-11061d83-c99d-4c18-8e31-82bebdb0c117" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:44 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da7c204-6c73-470a-b22f-b5d94c8b2f12]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:13:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5aefd3f6-a6e3-466c-a6b8-ec3f3803a73f tempest-CreateVolumesFromImageTest-2079471042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-11061d83-c99d-4c18-8e31-82bebdb0c117 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:44 devstack sudo[102254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-11061d83-c99d-4c18-8e31-82bebdb0c117
Sep 07 18:13:44 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:44 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-61efb860-e6b4-4b91-938f-7863dbdcc5e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d" returned: 0 in 0.428s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-61efb860-e6b4-4b91-938f-7863dbdcc5e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d.b59d16b1-80aa-42ff-8d70-a5e8ba2bd986 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:44 devstack sudo[102260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d.b59d16b1-80aa-42ff-8d70-a5e8ba2bd986 1G
Sep 07 18:13:44 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:44 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5aefd3f6-a6e3-466c-a6b8-ec3f3803a73f tempest-CreateVolumesFromImageTest-2079471042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-11061d83-c99d-4c18-8e31-82bebdb0c117" returned: 0 in 0.429s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5aefd3f6-a6e3-466c-a6b8-ec3f3803a73f tempest-CreateVolumesFromImageTest-2079471042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-11061d83-c99d-4c18-8e31-82bebdb0c117 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:44 devstack sudo[102265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-11061d83-c99d-4c18-8e31-82bebdb0c117
Sep 07 18:13:44 devstack sudo[102265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:44 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:44 devstack sudo[102265]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5aefd3f6-a6e3-466c-a6b8-ec3f3803a73f tempest-CreateVolumesFromImageTest-2079471042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-11061d83-c99d-4c18-8e31-82bebdb0c117" returned: 0 in 0.297s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-61efb860-e6b4-4b91-938f-7863dbdcc5e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d.b59d16b1-80aa-42ff-8d70-a5e8ba2bd986 1G" returned: 0 in 0.491s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-61efb860-e6b4-4b91-938f-7863dbdcc5e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a775eea3-091e-48a9-a14e-419e69be965d -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d.b59d16b1-80aa-42ff-8d70-a5e8ba2bd986 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5aefd3f6-a6e3-466c-a6b8-ec3f3803a73f tempest-CreateVolumesFromImageTest-2079471042 None] Lock "cinder-quobyte-11061d83-c99d-4c18-8e31-82bebdb0c117" released by "delete_volume" :: held 0.775s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:45 devstack sudo[102272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a775eea3-091e-48a9-a14e-419e69be965d -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d.b59d16b1-80aa-42ff-8d70-a5e8ba2bd986
Sep 07 18:13:45 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:45 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-5aefd3f6-a6e3-466c-a6b8-ec3f3803a73f tempest-CreateVolumesFromImageTest-2079471042 None] Created reservations ['3db4c070-d95f-42a5-bbae-4961474c16e4', 'cb29edfd-f087-4b1a-9d10-459ccbd0c505', 'f187c7c2-3eb8-4509-b20a-0617d0f8adcc', '907b75bb-1fa8-4b36-814e-cc8334234115'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:13:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5aefd3f6-a6e3-466c-a6b8-ec3f3803a73f tempest-CreateVolumesFromImageTest-2079471042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5aefd3f6-a6e3-466c-a6b8-ec3f3803a73f tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5aefd3f6-a6e3-466c-a6b8-ec3f3803a73f tempest-CreateVolumesFromImageTest-2079471042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5aefd3f6-a6e3-466c-a6b8-ec3f3803a73f tempest-CreateVolumesFromImageTest-2079471042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5aefd3f6-a6e3-466c-a6b8-ec3f3803a73f tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5aefd3f6-a6e3-466c-a6b8-ec3f3803a73f tempest-CreateVolumesFromImageTest-2079471042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:45 devstack sudo[102274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:13:45 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c0852008-759b-4904-bd86-a397fb82a275 tempest-CreateVolumesFromImageTest-2079471042 None] Acquiring lock "cinder-888e67a3-212d-4830-8a90-b5da48a12232-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c0852008-759b-4904-bd86-a397fb82a275 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "cinder-888e67a3-212d-4830-8a90-b5da48a12232-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:45 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-61efb860-e6b4-4b91-938f-7863dbdcc5e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a775eea3-091e-48a9-a14e-419e69be965d -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d.b59d16b1-80aa-42ff-8d70-a5e8ba2bd986" returned: 0 in 0.377s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:45 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-61efb860-e6b4-4b91-938f-7863dbdcc5e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d.b59d16b1-80aa-42ff-8d70-a5e8ba2bd986 is being set with open permissions: ugo+rw
Sep 07 18:13:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-61efb860-e6b4-4b91-938f-7863dbdcc5e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d.b59d16b1-80aa-42ff-8d70-a5e8ba2bd986 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:45 devstack sudo[102279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d.b59d16b1-80aa-42ff-8d70-a5e8ba2bd986
Sep 07 18:13:45 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c0852008-759b-4904-bd86-a397fb82a275 tempest-CreateVolumesFromImageTest-2079471042 None] Acquiring lock "cinder-quobyte-888e67a3-212d-4830-8a90-b5da48a12232" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:45 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5aefd3f6-a6e3-466c-a6b8-ec3f3803a73f tempest-CreateVolumesFromImageTest-2079471042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.291s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:45 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-5aefd3f6-a6e3-466c-a6b8-ec3f3803a73f tempest-CreateVolumesFromImageTest-2079471042 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:13:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c0852008-759b-4904-bd86-a397fb82a275 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "cinder-quobyte-888e67a3-212d-4830-8a90-b5da48a12232" acquired by "delete_volume" :: waited 0.030s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:45 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5aefd3f6-a6e3-466c-a6b8-ec3f3803a73f tempest-CreateVolumesFromImageTest-2079471042 None] Deleted volume successfully.
Sep 07 18:13:45 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c937c6b0-163d-4512-8228-2e4189228a73]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:13:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c0852008-759b-4904-bd86-a397fb82a275 tempest-CreateVolumesFromImageTest-2079471042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-888e67a3-212d-4830-8a90-b5da48a12232 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5aefd3f6-a6e3-466c-a6b8-ec3f3803a73f tempest-CreateVolumesFromImageTest-2079471042 None] Lock "cinder-11061d83-c99d-4c18-8e31-82bebdb0c117-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:45 devstack sudo[102282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-888e67a3-212d-4830-8a90-b5da48a12232
Sep 07 18:13:45 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:45 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-61efb860-e6b4-4b91-938f-7863dbdcc5e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d.b59d16b1-80aa-42ff-8d70-a5e8ba2bd986" returned: 0 in 0.295s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-61efb860-e6b4-4b91-938f-7863dbdcc5e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:45 devstack sudo[102285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d.info
Sep 07 18:13:45 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:45 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c0852008-759b-4904-bd86-a397fb82a275 tempest-CreateVolumesFromImageTest-2079471042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-888e67a3-212d-4830-8a90-b5da48a12232" returned: 0 in 0.407s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c0852008-759b-4904-bd86-a397fb82a275 tempest-CreateVolumesFromImageTest-2079471042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-888e67a3-212d-4830-8a90-b5da48a12232 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:45 devstack sudo[102290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-888e67a3-212d-4830-8a90-b5da48a12232
Sep 07 18:13:45 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:45 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-61efb860-e6b4-4b91-938f-7863dbdcc5e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d.info" returned: 0 in 0.272s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:45 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-61efb860-e6b4-4b91-938f-7863dbdcc5e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d.info is being set with open permissions: ugo+rw
Sep 07 18:13:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-61efb860-e6b4-4b91-938f-7863dbdcc5e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:46 devstack sudo[102293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d.info
Sep 07 18:13:46 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:46 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c0852008-759b-4904-bd86-a397fb82a275 tempest-CreateVolumesFromImageTest-2079471042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-888e67a3-212d-4830-8a90-b5da48a12232" returned: 0 in 0.267s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c0852008-759b-4904-bd86-a397fb82a275 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "cinder-quobyte-888e67a3-212d-4830-8a90-b5da48a12232" released by "delete_volume" :: held 0.733s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:46 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-61efb860-e6b4-4b91-938f-7863dbdcc5e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d.info" returned: 0 in 0.270s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:46 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-c0852008-759b-4904-bd86-a397fb82a275 tempest-CreateVolumesFromImageTest-2079471042 None] Created reservations ['531302fd-4f25-4377-810e-ea2e0c9c68ba', 'a6bfbb24-4b82-4067-976d-86530fce1ea6', 'edcc47c1-1992-4dfb-b282-764e2f147396', '29885a5e-c456-40a4-96f7-1cebda417afd'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:13:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-61efb860-e6b4-4b91-938f-7863dbdcc5e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.253s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:46 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-61efb860-e6b4-4b91-938f-7863dbdcc5e5 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Create snapshot completed successfully
Sep 07 18:13:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c0852008-759b-4904-bd86-a397fb82a275 tempest-CreateVolumesFromImageTest-2079471042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c0852008-759b-4904-bd86-a397fb82a275 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c0852008-759b-4904-bd86-a397fb82a275 tempest-CreateVolumesFromImageTest-2079471042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c0852008-759b-4904-bd86-a397fb82a275 tempest-CreateVolumesFromImageTest-2079471042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c0852008-759b-4904-bd86-a397fb82a275 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c0852008-759b-4904-bd86-a397fb82a275 tempest-CreateVolumesFromImageTest-2079471042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:46 devstack sudo[102298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:13:46 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-19ba0ea7-8ba2-4243-9f2a-3d0fa0047ae5 tempest-CreateVolumesFromImageTest-2079471042 None] Acquiring lock "cinder-aecd1104-590c-4ef6-ae23-4bc58544e099-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-19ba0ea7-8ba2-4243-9f2a-3d0fa0047ae5 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "cinder-aecd1104-590c-4ef6-ae23-4bc58544e099-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-19ba0ea7-8ba2-4243-9f2a-3d0fa0047ae5 tempest-CreateVolumesFromImageTest-2079471042 None] Acquiring lock "cinder-quobyte-aecd1104-590c-4ef6-ae23-4bc58544e099" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-19ba0ea7-8ba2-4243-9f2a-3d0fa0047ae5 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "cinder-quobyte-aecd1104-590c-4ef6-ae23-4bc58544e099" acquired by "delete_volume" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:46 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c0852008-759b-4904-bd86-a397fb82a275 tempest-CreateVolumesFromImageTest-2079471042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.292s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:46 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-c0852008-759b-4904-bd86-a397fb82a275 tempest-CreateVolumesFromImageTest-2079471042 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:13:46 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[af747fe8-25ba-40fc-8d17-594cc4948ab5]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:13:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-19ba0ea7-8ba2-4243-9f2a-3d0fa0047ae5 tempest-CreateVolumesFromImageTest-2079471042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aecd1104-590c-4ef6-ae23-4bc58544e099 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:46 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-c0852008-759b-4904-bd86-a397fb82a275 tempest-CreateVolumesFromImageTest-2079471042 None] Deleted volume successfully.
Sep 07 18:13:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c0852008-759b-4904-bd86-a397fb82a275 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "cinder-888e67a3-212d-4830-8a90-b5da48a12232-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:46 devstack sudo[102301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aecd1104-590c-4ef6-ae23-4bc58544e099
Sep 07 18:13:46 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:47 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-19ba0ea7-8ba2-4243-9f2a-3d0fa0047ae5 tempest-CreateVolumesFromImageTest-2079471042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aecd1104-590c-4ef6-ae23-4bc58544e099" returned: 0 in 0.384s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-19ba0ea7-8ba2-4243-9f2a-3d0fa0047ae5 tempest-CreateVolumesFromImageTest-2079471042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aecd1104-590c-4ef6-ae23-4bc58544e099 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:47 devstack sudo[102306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aecd1104-590c-4ef6-ae23-4bc58544e099
Sep 07 18:13:47 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:47 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-19ba0ea7-8ba2-4243-9f2a-3d0fa0047ae5 tempest-CreateVolumesFromImageTest-2079471042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aecd1104-590c-4ef6-ae23-4bc58544e099" returned: 0 in 0.262s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-19ba0ea7-8ba2-4243-9f2a-3d0fa0047ae5 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "cinder-quobyte-aecd1104-590c-4ef6-ae23-4bc58544e099" released by "delete_volume" :: held 0.698s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-19ba0ea7-8ba2-4243-9f2a-3d0fa0047ae5 tempest-CreateVolumesFromImageTest-2079471042 None] Created reservations ['e3d126d0-4b8d-496d-952c-d68c6fc91eac', '53d6414b-75a3-4d7b-a447-3164b0ebfc9d', '00ca50b2-803a-4e86-b5f5-43c7989f23ed', 'b0dc77ca-3656-45bc-b86a-c23b5b449526'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-19ba0ea7-8ba2-4243-9f2a-3d0fa0047ae5 tempest-CreateVolumesFromImageTest-2079471042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-19ba0ea7-8ba2-4243-9f2a-3d0fa0047ae5 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-19ba0ea7-8ba2-4243-9f2a-3d0fa0047ae5 tempest-CreateVolumesFromImageTest-2079471042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-19ba0ea7-8ba2-4243-9f2a-3d0fa0047ae5 tempest-CreateVolumesFromImageTest-2079471042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-19ba0ea7-8ba2-4243-9f2a-3d0fa0047ae5 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-19ba0ea7-8ba2-4243-9f2a-3d0fa0047ae5 tempest-CreateVolumesFromImageTest-2079471042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:47 devstack sudo[102309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:13:47 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3608607c-1f0b-44e2-98b7-a0d113c3f9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Acquiring lock "cinder-b59d16b1-80aa-42ff-8d70-a5e8ba2bd986-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3608607c-1f0b-44e2-98b7-a0d113c3f9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Lock "cinder-b59d16b1-80aa-42ff-8d70-a5e8ba2bd986-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3608607c-1f0b-44e2-98b7-a0d113c3f9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Acquiring lock "cinder-quobyte-a775eea3-091e-48a9-a14e-419e69be965d" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3608607c-1f0b-44e2-98b7-a0d113c3f9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Lock "cinder-quobyte-a775eea3-091e-48a9-a14e-419e69be965d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3608607c-1f0b-44e2-98b7-a0d113c3f9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Acquiring lock "cinder-quobyte-b59d16b1-80aa-42ff-8d70-a5e8ba2bd986" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3608607c-1f0b-44e2-98b7-a0d113c3f9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Lock "cinder-quobyte-b59d16b1-80aa-42ff-8d70-a5e8ba2bd986" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-3608607c-1f0b-44e2-98b7-a0d113c3f9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Deleting offline snapshot b59d16b1-80aa-42ff-8d70-a5e8ba2bd986 of volume a775eea3-091e-48a9-a14e-419e69be965d {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:13:47 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-3608607c-1f0b-44e2-98b7-a0d113c3f9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] snapshot_file for this snap is: volume-a775eea3-091e-48a9-a14e-419e69be965d.b59d16b1-80aa-42ff-8d70-a5e8ba2bd986 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-01b9e712-90f1-4f9d-a794-b28f8487956d tempest-CreateVolumesFromImageTest-2079471042 None] Acquiring lock "cinder-e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-19ba0ea7-8ba2-4243-9f2a-3d0fa0047ae5 tempest-CreateVolumesFromImageTest-2079471042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.310s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-19ba0ea7-8ba2-4243-9f2a-3d0fa0047ae5 tempest-CreateVolumesFromImageTest-2079471042 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c478b1-9b7a-44d9-af9f-b05b79fdad0b]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3608607c-1f0b-44e2-98b7-a0d113c3f9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d.b59d16b1-80aa-42ff-8d70-a5e8ba2bd986 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:47 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-19ba0ea7-8ba2-4243-9f2a-3d0fa0047ae5 tempest-CreateVolumesFromImageTest-2079471042 None] Deleted volume successfully.
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-01b9e712-90f1-4f9d-a794-b28f8487956d tempest-CreateVolumesFromImageTest-2079471042 None] Lock "cinder-e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-19ba0ea7-8ba2-4243-9f2a-3d0fa0047ae5 tempest-CreateVolumesFromImageTest-2079471042 None] Lock "cinder-aecd1104-590c-4ef6-ae23-4bc58544e099-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-01b9e712-90f1-4f9d-a794-b28f8487956d tempest-CreateVolumesFromImageTest-2079471042 None] Acquiring lock "cinder-quobyte-e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-01b9e712-90f1-4f9d-a794-b28f8487956d tempest-CreateVolumesFromImageTest-2079471042 None] Lock "cinder-quobyte-e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1" acquired by "delete_volume" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4812a3-723a-46ba-b7a1-0f49fd5d2999]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:13:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-01b9e712-90f1-4f9d-a794-b28f8487956d tempest-CreateVolumesFromImageTest-2079471042 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:47 devstack sudo[102312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d.b59d16b1-80aa-42ff-8d70-a5e8ba2bd986
Sep 07 18:13:47 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:48 devstack sudo[102313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1
Sep 07 18:13:48 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:13:48 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Flow 'volume_create_manager' (9c731a8b-edaf-4187-8304-8a85a8bc1897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3a2bb3-d0bf-4aa0-a2f9-0e7b33742d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3608607c-1f0b-44e2-98b7-a0d113c3f9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d.b59d16b1-80aa-42ff-8d70-a5e8ba2bd986" returned: 0 in 0.496s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-3608607c-1f0b-44e2-98b7-a0d113c3f9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a775eea3-091e-48a9-a14e-419e69be965d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3a2bb3-d0bf-4aa0-a2f9-0e7b33742d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-298979284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f69a25a21ab3456aaf09b3ebfab83933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:13:48Z,use_quota=True,user_id='346be42269ff4bda9bcd2f5cac503e75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec1ce8c-03ce-4e82-ab2e-1792cce9a417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec1ce8c-03ce-4e82-ab2e-1792cce9a417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f847e897-bb48-4302-afc1-42308348d474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f847e897-bb48-4302-afc1-42308348d474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac', 'volume_name': 'volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (778f94b6-b9a1-41f2-999d-053baa50b77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:48 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (778f94b6-b9a1-41f2-999d-053baa50b77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d2776a-2b2b-4dd7-a5c4-9d19958f6bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:48 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Volume cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac', 'volume_size': 1}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-298979284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f69a25a21ab3456aaf09b3ebfab83933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:13:48Z,use_quota=True,user_id='346be42269ff4bda9bcd2f5cac503e75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Creating volume cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:13:48 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8556829c-c7bb-440e-8b48-76d7de3d9dea]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3608607c-1f0b-44e2-98b7-a0d113c3f9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:48 devstack sudo[102323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac 1073741824
Sep 07 18:13:48 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-01b9e712-90f1-4f9d-a794-b28f8487956d tempest-CreateVolumesFromImageTest-2079471042 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1" returned: 0 in 0.461s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-01b9e712-90f1-4f9d-a794-b28f8487956d tempest-CreateVolumesFromImageTest-2079471042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:48 devstack sudo[102326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1
Sep 07 18:13:48 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:48 devstack sudo[102324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d
Sep 07 18:13:48 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:48 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-01b9e712-90f1-4f9d-a794-b28f8487956d tempest-CreateVolumesFromImageTest-2079471042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1" returned: 0 in 0.247s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-01b9e712-90f1-4f9d-a794-b28f8487956d tempest-CreateVolumesFromImageTest-2079471042 None] Lock "cinder-quobyte-e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1" released by "delete_volume" :: held 0.753s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-01b9e712-90f1-4f9d-a794-b28f8487956d tempest-CreateVolumesFromImageTest-2079471042 None] Created reservations ['c2e2b233-2459-4453-a8a3-6261637604bb', 'b68fdbb3-3f7c-4f27-a1fa-724aa7d9c2e0', 'c14857ad-ce64-438a-bc22-ac5e7461db4c', '1e95a524-3cae-4666-a4ef-f6643e6fe9e9'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-01b9e712-90f1-4f9d-a794-b28f8487956d tempest-CreateVolumesFromImageTest-2079471042 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-01b9e712-90f1-4f9d-a794-b28f8487956d tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-01b9e712-90f1-4f9d-a794-b28f8487956d tempest-CreateVolumesFromImageTest-2079471042 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:48 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-01b9e712-90f1-4f9d-a794-b28f8487956d tempest-CreateVolumesFromImageTest-2079471042 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-01b9e712-90f1-4f9d-a794-b28f8487956d tempest-CreateVolumesFromImageTest-2079471042 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-01b9e712-90f1-4f9d-a794-b28f8487956d tempest-CreateVolumesFromImageTest-2079471042 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3608607c-1f0b-44e2-98b7-a0d113c3f9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d" returned: 0 in 0.419s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3608607c-1f0b-44e2-98b7-a0d113c3f9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d.b59d16b1-80aa-42ff-8d70-a5e8ba2bd986 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:48 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac 1073741824" returned: 0 in 0.448s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:48 devstack sudo[102337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:13:48 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:48 devstack sudo[102338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d.b59d16b1-80aa-42ff-8d70-a5e8ba2bd986
Sep 07 18:13:48 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:48 devstack sudo[102341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac
Sep 07 18:13:48 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:49 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-01b9e712-90f1-4f9d-a794-b28f8487956d tempest-CreateVolumesFromImageTest-2079471042 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.264s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:49 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-01b9e712-90f1-4f9d-a794-b28f8487956d tempest-CreateVolumesFromImageTest-2079471042 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:13:49 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-01b9e712-90f1-4f9d-a794-b28f8487956d tempest-CreateVolumesFromImageTest-2079471042 None] Deleted volume successfully.
Sep 07 18:13:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-01b9e712-90f1-4f9d-a794-b28f8487956d tempest-CreateVolumesFromImageTest-2079471042 None] Lock "cinder-e83eaaa8-9d07-48f0-b033-d7b5b7e3b9f1-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:49 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac" returned: 0 in 0.298s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:13:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d2776a-2b2b-4dd7-a5c4-9d19958f6bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be94d5fd-0d61-454a-8f9f-b3bcbc210450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:49 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Volume volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac (cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac): created successfully
Sep 07 18:13:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be94d5fd-0d61-454a-8f9f-b3bcbc210450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:49 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Flow 'volume_create_manager' (9c731a8b-edaf-4187-8304-8a85a8bc1897) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:13:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3608607c-1f0b-44e2-98b7-a0d113c3f9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d.b59d16b1-80aa-42ff-8d70-a5e8ba2bd986" returned: 0 in 0.447s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3608607c-1f0b-44e2-98b7-a0d113c3f9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d.b59d16b1-80aa-42ff-8d70-a5e8ba2bd986 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:49 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9c24a52d-25ab-41b5-a17c-47e22af59516 tempest-VolumeDependencyTests-200285121 None] Created volume successfully.
Sep 07 18:13:49 devstack sudo[102350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d.b59d16b1-80aa-42ff-8d70-a5e8ba2bd986
Sep 07 18:13:49 devstack sudo[102350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:49 devstack sudo[102350]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3608607c-1f0b-44e2-98b7-a0d113c3f9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d.b59d16b1-80aa-42ff-8d70-a5e8ba2bd986" returned: 0 in 0.244s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3608607c-1f0b-44e2-98b7-a0d113c3f9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Lock "cinder-quobyte-b59d16b1-80aa-42ff-8d70-a5e8ba2bd986" released by "_delete_snapshot" :: held 1.791s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3608607c-1f0b-44e2-98b7-a0d113c3f9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Lock "cinder-quobyte-a775eea3-091e-48a9-a14e-419e69be965d" released by "delete_snapshot" :: held 1.828s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:49 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-3608607c-1f0b-44e2-98b7-a0d113c3f9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Created reservations ['450c69d3-c1a3-44c7-9e84-5482effcb213', '69d0436d-f39e-43ae-a9cd-83030f3e2159', 'a8463ef5-f8ff-4c9a-99c2-73d85349b9f7', 'a5e0a00c-021b-49ac-85af-d5ff660561eb'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:13:49 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3608607c-1f0b-44e2-98b7-a0d113c3f9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Delete snapshot completed successfully.
Sep 07 18:13:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3608607c-1f0b-44e2-98b7-a0d113c3f9e8 tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Lock "cinder-b59d16b1-80aa-42ff-8d70-a5e8ba2bd986-delete_snapshot" released by "delete_snapshot" :: held 1.968s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b4c83807-6967-4fee-998b-79f320801efa tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Acquiring lock "cinder-a775eea3-091e-48a9-a14e-419e69be965d-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b4c83807-6967-4fee-998b-79f320801efa tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Lock "cinder-a775eea3-091e-48a9-a14e-419e69be965d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b4c83807-6967-4fee-998b-79f320801efa tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Acquiring lock "cinder-quobyte-a775eea3-091e-48a9-a14e-419e69be965d" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b4c83807-6967-4fee-998b-79f320801efa tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Lock "cinder-quobyte-a775eea3-091e-48a9-a14e-419e69be965d" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:50 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff9de76-37a2-45ec-b539-63de322d0025]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:13:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b4c83807-6967-4fee-998b-79f320801efa tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:50 devstack sudo[102353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d
Sep 07 18:13:50 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:50 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b4c83807-6967-4fee-998b-79f320801efa tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d" returned: 0 in 0.442s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b4c83807-6967-4fee-998b-79f320801efa tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:50 devstack sudo[102360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d
Sep 07 18:13:50 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-33f78e8b-ec35-4feb-b6ac-51aa4cfa6f64 tempest-VolumeDependencyTests-200285121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-33f78e8b-ec35-4feb-b6ac-51aa4cfa6f64 tempest-VolumeDependencyTests-200285121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-33f78e8b-ec35-4feb-b6ac-51aa4cfa6f64 tempest-VolumeDependencyTests-200285121 None] Creating offline snapshot 5dfd909c-71fe-4596-a385-100d52809269 of volume cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:13:50 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a394a1e1-29f0-4cdf-bd6a-f6822403a6ed]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:13:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-33f78e8b-ec35-4feb-b6ac-51aa4cfa6f64 tempest-VolumeDependencyTests-200285121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:50 devstack sudo[102362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac
Sep 07 18:13:50 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:50 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b4c83807-6967-4fee-998b-79f320801efa tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a775eea3-091e-48a9-a14e-419e69be965d" returned: 0 in 0.311s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b4c83807-6967-4fee-998b-79f320801efa tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Lock "cinder-quobyte-a775eea3-091e-48a9-a14e-419e69be965d" released by "delete_volume" :: held 0.830s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:50 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=146,cinder:UPDATE=162,cinder:DELETE=11,cinder:INSERT=40 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:13:50 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=173,cinder:SELECT=136,cinder:INSERT=36,cinder:DELETE=15 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:13:50 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-b4c83807-6967-4fee-998b-79f320801efa tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Created reservations ['defdbb72-b462-4303-a897-e58d2f1659b5', '74faf134-56b6-4cbe-ba0a-5b3520260fd1', '8ab0fa12-276b-4894-9ead-1ff0befdd208', 'd74c327d-81cc-4421-8c72-2bcc47d08ed0'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:13:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b4c83807-6967-4fee-998b-79f320801efa tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b4c83807-6967-4fee-998b-79f320801efa tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b4c83807-6967-4fee-998b-79f320801efa tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b4c83807-6967-4fee-998b-79f320801efa tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b4c83807-6967-4fee-998b-79f320801efa tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b4c83807-6967-4fee-998b-79f320801efa tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:51 devstack sudo[102366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:13:51 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:51 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-33f78e8b-ec35-4feb-b6ac-51aa4cfa6f64 tempest-VolumeDependencyTests-200285121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac" returned: 0 in 0.466s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-33f78e8b-ec35-4feb-b6ac-51aa4cfa6f64 tempest-VolumeDependencyTests-200285121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.5dfd909c-71fe-4596-a385-100d52809269 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:51 devstack sudo[102370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.5dfd909c-71fe-4596-a385-100d52809269 1G
Sep 07 18:13:51 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:51 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b4c83807-6967-4fee-998b-79f320801efa tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.305s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:51 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-b4c83807-6967-4fee-998b-79f320801efa tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:13:51 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b4c83807-6967-4fee-998b-79f320801efa tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Deleted volume successfully.
Sep 07 18:13:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b4c83807-6967-4fee-998b-79f320801efa tempest-VolumeSnapshotQuotasNegativeTestJSON-342570827 None] Lock "cinder-a775eea3-091e-48a9-a14e-419e69be965d-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:13:51 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-33f78e8b-ec35-4feb-b6ac-51aa4cfa6f64 tempest-VolumeDependencyTests-200285121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.5dfd909c-71fe-4596-a385-100d52809269 1G" returned: 0 in 0.515s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-33f78e8b-ec35-4feb-b6ac-51aa4cfa6f64 tempest-VolumeDependencyTests-200285121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.5dfd909c-71fe-4596-a385-100d52809269 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:51 devstack sudo[102377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.5dfd909c-71fe-4596-a385-100d52809269
Sep 07 18:13:51 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:51 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-33f78e8b-ec35-4feb-b6ac-51aa4cfa6f64 tempest-VolumeDependencyTests-200285121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.5dfd909c-71fe-4596-a385-100d52809269" returned: 0 in 0.330s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:51 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-33f78e8b-ec35-4feb-b6ac-51aa4cfa6f64 tempest-VolumeDependencyTests-200285121 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.5dfd909c-71fe-4596-a385-100d52809269 is being set with open permissions: ugo+rw
Sep 07 18:13:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-33f78e8b-ec35-4feb-b6ac-51aa4cfa6f64 tempest-VolumeDependencyTests-200285121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.5dfd909c-71fe-4596-a385-100d52809269 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:51 devstack sudo[102382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.5dfd909c-71fe-4596-a385-100d52809269
Sep 07 18:13:51 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:52 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-33f78e8b-ec35-4feb-b6ac-51aa4cfa6f64 tempest-VolumeDependencyTests-200285121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.5dfd909c-71fe-4596-a385-100d52809269" returned: 0 in 0.287s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-33f78e8b-ec35-4feb-b6ac-51aa4cfa6f64 tempest-VolumeDependencyTests-200285121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:52 devstack sudo[102385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.info
Sep 07 18:13:52 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Flow 'volume_create_manager' (67115706-14dc-4a0e-af78-c2f52996a5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff9ad6e-e85f-4dd2-bbce-c2cf6943905f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff9ad6e-e85f-4dd2-bbce-c2cf6943905f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1214856709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa262765-067c-4706-ba4d-a0129831c09d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb09cedfca745dab47cf92c1d3898a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:13:52Z,use_quota=True,user_id='da34c9eebf464e388b6e737089242acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efee3eee-4639-4958-adf3-08e64b2e6458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efee3eee-4639-4958-adf3-08e64b2e6458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (855415ee-c20b-45e5-be57-55e66ec178da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (855415ee-c20b-45e5-be57-55e66ec178da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa262765-067c-4706-ba4d-a0129831c09d', 'volume_name': 'volume-aa262765-067c-4706-ba4d-a0129831c09d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0175ae60-6302-48b1-9f72-8038dc021ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0175ae60-6302-48b1-9f72-8038dc021ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd6ba662-eecb-4106-a3d1-c6a9dce0768b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:52 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Volume aa262765-067c-4706-ba4d-a0129831c09d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa262765-067c-4706-ba4d-a0129831c09d', 'volume_size': 1}
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:52 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-33f78e8b-ec35-4feb-b6ac-51aa4cfa6f64 tempest-VolumeDependencyTests-200285121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.info" returned: 0 in 0.263s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:52 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-33f78e8b-ec35-4feb-b6ac-51aa4cfa6f64 tempest-VolumeDependencyTests-200285121 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.info is being set with open permissions: ugo+rw
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-33f78e8b-ec35-4feb-b6ac-51aa4cfa6f64 tempest-VolumeDependencyTests-200285121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:52 devstack sudo[102388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.info
Sep 07 18:13:52 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:52 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-33f78e8b-ec35-4feb-b6ac-51aa4cfa6f64 tempest-VolumeDependencyTests-200285121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.info" returned: 0 in 0.257s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-33f78e8b-ec35-4feb-b6ac-51aa4cfa6f64 tempest-VolumeDependencyTests-200285121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.229s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.314s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1214856709',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa262765-067c-4706-ba4d-a0129831c09d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb09cedfca745dab47cf92c1d3898a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:13:52Z,use_quota=True,user_id='da34c9eebf464e388b6e737089242acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Creating volume aa262765-067c-4706-ba4d-a0129831c09d {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:13:52 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:13:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:52 devstack sudo[102391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d 1073741824
Sep 07 18:13:52 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:52 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-33f78e8b-ec35-4feb-b6ac-51aa4cfa6f64 tempest-VolumeDependencyTests-200285121 None] Create snapshot completed successfully
Sep 07 18:13:53 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d 1073741824" returned: 0 in 0.451s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:53 devstack sudo[102397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d
Sep 07 18:13:53 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:53 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d" returned: 0 in 0.256s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:13:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd6ba662-eecb-4106-a3d1-c6a9dce0768b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa262765-067c-4706-ba4d-a0129831c09d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd371acb-961e-4348-9e5f-7769a199428f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:53 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Volume volume-aa262765-067c-4706-ba4d-a0129831c09d (aa262765-067c-4706-ba4d-a0129831c09d): created successfully
Sep 07 18:13:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd371acb-961e-4348-9e5f-7769a199428f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Flow 'volume_create_manager' (67115706-14dc-4a0e-af78-c2f52996a5a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:13:53 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-c111289c-d9ed-43ef-9b48-1a0532d58e8c tempest-CreateVolumesFromSnapshotTest-291271286 None] Created volume successfully.
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Flow 'volume_create_manager' (f10308b7-4f57-4c52-9d2d-fdaa3691a6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b431d847-4756-4efd-8baa-500b0e489987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b431d847-4756-4efd-8baa-500b0e489987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2007282284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=014be4c7-2e7c-42e1-8145-5b0275e7ac77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f69a25a21ab3456aaf09b3ebfab83933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5dfd909c-71fe-4596-a385-100d52809269,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:13:54Z,use_quota=True,user_id='346be42269ff4bda9bcd2f5cac503e75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eddd143-f800-4604-8c29-059a4154977f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eddd143-f800-4604-8c29-059a4154977f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0bd5261-90a1-42a0-ad58-0681911232e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0bd5261-90a1-42a0-ad58-0681911232e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '014be4c7-2e7c-42e1-8145-5b0275e7ac77', 'volume_name': 'volume-014be4c7-2e7c-42e1-8145-5b0275e7ac77', 'volume_size': 1, 'snapshot_id': '5dfd909c-71fe-4596-a385-100d52809269'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52dbf003-7b3d-416e-84e9-71677b21abb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52dbf003-7b3d-416e-84e9-71677b21abb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72e3c209-9987-4dd8-92d9-726e75793845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:13:54 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Volume 014be4c7-2e7c-42e1-8145-5b0275e7ac77: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-014be4c7-2e7c-42e1-8145-5b0275e7ac77', 'volume_size': 1, 'snapshot_id': '5dfd909c-71fe-4596-a385-100d52809269'}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Acquiring lock "cinder-quobyte-5dfd909c-71fe-4596-a385-100d52809269-014be4c7-2e7c-42e1-8145-5b0275e7ac77" by "_create_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Lock "cinder-quobyte-5dfd909c-71fe-4596-a385-100d52809269-014be4c7-2e7c-42e1-8145-5b0275e7ac77" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Creating volume 014be4c7-2e7c-42e1-8145-5b0275e7ac77 from snapshot 5dfd909c-71fe-4596-a385-100d52809269 {{(pid=87269) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Acquiring lock "cinder-quobyte-014be4c7-2e7c-42e1-8145-5b0275e7ac77" by "_copy_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Lock "cinder-quobyte-014be4c7-2e7c-42e1-8145-5b0275e7ac77" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] snapshot: 5dfd909c-71fe-4596-a385-100d52809269, volume: 014be4c7-2e7c-42e1-8145-5b0275e7ac77,  {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac907ac7-517e-4dac-8106-7d839327d207]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.5dfd909c-71fe-4596-a385-100d52809269 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:54 devstack sudo[102400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.5dfd909c-71fe-4596-a385-100d52809269
Sep 07 18:13:54 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-66e461f1-9fd8-45cd-9148-82c61c576069 tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:13:54 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.5dfd909c-71fe-4596-a385-100d52809269" returned: 0 in 0.403s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6efd79f-e4bb-4988-86b5-3d3eb89e8b1f]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:13:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:55 devstack sudo[102405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac
Sep 07 18:13:55 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:13:55 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root
Sep 07 18:13:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac" returned: 0 in 0.372s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:13:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] will copy from snapshot at /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 07 18:13:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Creating direct copy from snapshot {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 07 18:13:55 devstack cinder-volume[87269]: DEBUG cinder.utils [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Path /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-014be4c7-2e7c-42e1-8145-5b0275e7ac77 not found in is_blk_device check {{(pid=87269) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 07 18:13:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-014be4c7-2e7c-42e1-8145-5b0275e7ac77 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:13:55 devstack sudo[102410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-014be4c7-2e7c-42e1-8145-5b0275e7ac77
Sep 07 18:13:55 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:00 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-014be4c7-2e7c-42e1-8145-5b0275e7ac77" returned: 0 in 4.706s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Image conversion details: src /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac, size 1024.00 MB, duration 4.71 sec, destination /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-014be4c7-2e7c-42e1-8145-5b0275e7ac77 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 07 18:14:00 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Converted 1024.00 MB image at 217.53 MB/s
Sep 07 18:14:00 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-014be4c7-2e7c-42e1-8145-5b0275e7ac77 is being set with open permissions: ugo+rw
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-014be4c7-2e7c-42e1-8145-5b0275e7ac77 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:00 devstack sudo[102424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-014be4c7-2e7c-42e1-8145-5b0275e7ac77
Sep 07 18:14:00 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:00 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-014be4c7-2e7c-42e1-8145-5b0275e7ac77" returned: 0 in 0.243s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Lock "cinder-quobyte-014be4c7-2e7c-42e1-8145-5b0275e7ac77" released by "_copy_volume_from_snapshot" :: held 5.817s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Lock "cinder-quobyte-5dfd909c-71fe-4596-a385-100d52809269-014be4c7-2e7c-42e1-8145-5b0275e7ac77" released by "_create_volume_from_snapshot" :: held 5.882s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.902s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-66e461f1-9fd8-45cd-9148-82c61c576069 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.554s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-66e461f1-9fd8-45cd-9148-82c61c576069 tempest-CreateVolumesFromSnapshotTest-291271286 None] Creating offline snapshot 24a31956-03d6-4789-b4f5-13800f7f87b3 of volume aa262765-067c-4706-ba4d-a0129831c09d {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72e3c209-9987-4dd8-92d9-726e75793845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-014be4c7-2e7c-42e1-8145-5b0275e7ac77', 'volume_size': 1, 'snapshot_id': '5dfd909c-71fe-4596-a385-100d52809269'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a1d507-54c3-497f-846f-fe3aec327c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f4a459-4b1d-4c51-b5e1-1059b6437d2f]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-66e461f1-9fd8-45cd-9148-82c61c576069 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:00 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Volume volume-014be4c7-2e7c-42e1-8145-5b0275e7ac77 (014be4c7-2e7c-42e1-8145-5b0275e7ac77): created successfully
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77a1d507-54c3-497f-846f-fe3aec327c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Flow 'volume_create_manager' (f10308b7-4f57-4c52-9d2d-fdaa3691a6d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:00 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ab9ff03d-327d-438d-b4b6-74a260fe52e8 tempest-VolumeDependencyTests-200285121 None] Created volume successfully.
Sep 07 18:14:00 devstack sudo[102427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d
Sep 07 18:14:00 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:00 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-66e461f1-9fd8-45cd-9148-82c61c576069 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d" returned: 0 in 0.381s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-66e461f1-9fd8-45cd-9148-82c61c576069 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d.24a31956-03d6-4789-b4f5-13800f7f87b3 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:00 devstack sudo[102432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d.24a31956-03d6-4789-b4f5-13800f7f87b3 1G
Sep 07 18:14:00 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:00 devstack sudo[102434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:14:00 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-984da8c5-1a97-4846-af18-0c33fa76da03 tempest-VolumeDependencyTests-200285121 None] Acquiring lock "cinder-5dfd909c-71fe-4596-a385-100d52809269-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-984da8c5-1a97-4846-af18-0c33fa76da03 tempest-VolumeDependencyTests-200285121 None] Lock "cinder-5dfd909c-71fe-4596-a385-100d52809269-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-984da8c5-1a97-4846-af18-0c33fa76da03 tempest-VolumeDependencyTests-200285121 None] Acquiring lock "cinder-quobyte-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-984da8c5-1a97-4846-af18-0c33fa76da03 tempest-VolumeDependencyTests-200285121 None] Lock "cinder-quobyte-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-984da8c5-1a97-4846-af18-0c33fa76da03 tempest-VolumeDependencyTests-200285121 None] Acquiring lock "cinder-quobyte-5dfd909c-71fe-4596-a385-100d52809269" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-984da8c5-1a97-4846-af18-0c33fa76da03 tempest-VolumeDependencyTests-200285121 None] Lock "cinder-quobyte-5dfd909c-71fe-4596-a385-100d52809269" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-984da8c5-1a97-4846-af18-0c33fa76da03 tempest-VolumeDependencyTests-200285121 None] Deleting offline snapshot 5dfd909c-71fe-4596-a385-100d52809269 of volume cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:14:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-984da8c5-1a97-4846-af18-0c33fa76da03 tempest-VolumeDependencyTests-200285121 None] snapshot_file for this snap is: volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.5dfd909c-71fe-4596-a385-100d52809269 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:14:01 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f5b2c0-9ace-4cc6-a4b8-64a39d40220b]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-984da8c5-1a97-4846-af18-0c33fa76da03 tempest-VolumeDependencyTests-200285121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.5dfd909c-71fe-4596-a385-100d52809269 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:01 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.283s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:14:01 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:14:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 07 18:14:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread info: [<_MainThread(MainThread, started 137533762306176)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137533650971072)>, <Thread(Thread-3 (stat_writer), started daemon 137533647226880)>, <Thread(Rabbit-heartbeat, started daemon 137533647437120)>, <Thread(Thread-5 (_runner), started daemon 137533648120896)>, <Thread(Thread-7 (_runner), started daemon 137533648182592)>, <Thread(fd_logger, started daemon 137533644336576)>, <Thread(privsep_reader, started daemon 137533643255424)>, <Thread(tpool_thread_0, started daemon 137533635446464)>, <Thread(tpool_thread_1, started daemon 137533627053760)>, <Thread(tpool_thread_2, started daemon 137533618661056)>, <Thread(tpool_thread_3, started daemon 137533610251968)>, <Thread(tpool_thread_4, started daemon 137533601842880)>, <Thread(tpool_thread_5, started daemon 137533593433792)>, <Thread(tpool_thread_6, started daemon 137533585024704)>, <Thread(tpool_thread_7, started daemon 137533576615616)>, <Thread(tpool_thread_8, started daemon 137533568206528)>, <Thread(tpool_thread_9, started daemon 137533559797440)>, <Thread(tpool_thread_10, started daemon 137533551388352)>, <Thread(tpool_thread_11, started daemon 137533542979264)>, <Thread(tpool_thread_12, started daemon 137533534570176)>, <Thread(tpool_thread_13, started daemon 137533526161088)>, <Thread(tpool_thread_14, started daemon 137533517752000)>, <Thread(tpool_thread_15, started daemon 137533509342912)>, <Thread(tpool_thread_16, started daemon 137533500933824)>, <Thread(tpool_thread_17, started daemon 137533492524736)>, <Thread(tpool_thread_18, started daemon 137533484115648)>, <Thread(tpool_thread_19, started daemon 137533475706560)>] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 07 18:14:01 devstack sudo[102437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.5dfd909c-71fe-4596-a385-100d52809269
Sep 07 18:14:01 devstack sudo[102437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:01 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-66e461f1-9fd8-45cd-9148-82c61c576069 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d.24a31956-03d6-4789-b4f5-13800f7f87b3 1G" returned: 0 in 0.528s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-66e461f1-9fd8-45cd-9148-82c61c576069 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa262765-067c-4706-ba4d-a0129831c09d -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d.24a31956-03d6-4789-b4f5-13800f7f87b3 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:01 devstack sudo[102442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa262765-067c-4706-ba4d-a0129831c09d -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d.24a31956-03d6-4789-b4f5-13800f7f87b3
Sep 07 18:14:01 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:01 devstack sudo[102437]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-984da8c5-1a97-4846-af18-0c33fa76da03 tempest-VolumeDependencyTests-200285121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.5dfd909c-71fe-4596-a385-100d52809269" returned: 0 in 0.381s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-984da8c5-1a97-4846-af18-0c33fa76da03 tempest-VolumeDependencyTests-200285121 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:14:01 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c98b1c3-281c-4395-b88e-841717697b5a]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-984da8c5-1a97-4846-af18-0c33fa76da03 tempest-VolumeDependencyTests-200285121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:01 devstack sudo[102447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac
Sep 07 18:14:01 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:01 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-66e461f1-9fd8-45cd-9148-82c61c576069 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa262765-067c-4706-ba4d-a0129831c09d -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d.24a31956-03d6-4789-b4f5-13800f7f87b3" returned: 0 in 0.335s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:01 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-66e461f1-9fd8-45cd-9148-82c61c576069 tempest-CreateVolumesFromSnapshotTest-291271286 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d.24a31956-03d6-4789-b4f5-13800f7f87b3 is being set with open permissions: ugo+rw
Sep 07 18:14:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-66e461f1-9fd8-45cd-9148-82c61c576069 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d.24a31956-03d6-4789-b4f5-13800f7f87b3 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:01 devstack sudo[102452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d.24a31956-03d6-4789-b4f5-13800f7f87b3
Sep 07 18:14:01 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:01 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-66e461f1-9fd8-45cd-9148-82c61c576069 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d.24a31956-03d6-4789-b4f5-13800f7f87b3" returned: 0 in 0.252s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-66e461f1-9fd8-45cd-9148-82c61c576069 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:01 devstack sudo[102458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d.info
Sep 07 18:14:01 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:02 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-984da8c5-1a97-4846-af18-0c33fa76da03 tempest-VolumeDependencyTests-200285121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac" returned: 0 in 0.630s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-984da8c5-1a97-4846-af18-0c33fa76da03 tempest-VolumeDependencyTests-200285121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.5dfd909c-71fe-4596-a385-100d52809269 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:02 devstack sudo[102461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.5dfd909c-71fe-4596-a385-100d52809269
Sep 07 18:14:02 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:02 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-66e461f1-9fd8-45cd-9148-82c61c576069 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d.info" returned: 0 in 0.271s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:02 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-66e461f1-9fd8-45cd-9148-82c61c576069 tempest-CreateVolumesFromSnapshotTest-291271286 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d.info is being set with open permissions: ugo+rw
Sep 07 18:14:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-66e461f1-9fd8-45cd-9148-82c61c576069 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:02 devstack sudo[102464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d.info
Sep 07 18:14:02 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:02 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-66e461f1-9fd8-45cd-9148-82c61c576069 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d.info" returned: 0 in 0.263s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:02 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-66e461f1-9fd8-45cd-9148-82c61c576069 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.150s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-984da8c5-1a97-4846-af18-0c33fa76da03 tempest-VolumeDependencyTests-200285121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.5dfd909c-71fe-4596-a385-100d52809269" returned: 0 in 0.371s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-984da8c5-1a97-4846-af18-0c33fa76da03 tempest-VolumeDependencyTests-200285121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.5dfd909c-71fe-4596-a385-100d52809269 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:02 devstack sudo[102470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.5dfd909c-71fe-4596-a385-100d52809269
Sep 07 18:14:02 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:02 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-66e461f1-9fd8-45cd-9148-82c61c576069 tempest-CreateVolumesFromSnapshotTest-291271286 None] Create snapshot completed successfully
Sep 07 18:14:02 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-984da8c5-1a97-4846-af18-0c33fa76da03 tempest-VolumeDependencyTests-200285121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac.5dfd909c-71fe-4596-a385-100d52809269" returned: 0 in 0.270s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-984da8c5-1a97-4846-af18-0c33fa76da03 tempest-VolumeDependencyTests-200285121 None] Lock "cinder-quobyte-5dfd909c-71fe-4596-a385-100d52809269" released by "_delete_snapshot" :: held 1.786s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-984da8c5-1a97-4846-af18-0c33fa76da03 tempest-VolumeDependencyTests-200285121 None] Lock "cinder-quobyte-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac" released by "delete_snapshot" :: held 1.812s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:02 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-984da8c5-1a97-4846-af18-0c33fa76da03 tempest-VolumeDependencyTests-200285121 None] Created reservations ['608f8b27-ae96-43e5-92e2-e623b2040934', 'bdbc68a3-9523-43f6-855e-6d28c184d7ce', 'bdadeaa8-282d-4c10-8f87-c4c85380ff67', '5212a22b-40ed-4b56-a9d1-6dd3831bd50c'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:14:02 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-984da8c5-1a97-4846-af18-0c33fa76da03 tempest-VolumeDependencyTests-200285121 None] Delete snapshot completed successfully.
Sep 07 18:14:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-984da8c5-1a97-4846-af18-0c33fa76da03 tempest-VolumeDependencyTests-200285121 None] Lock "cinder-5dfd909c-71fe-4596-a385-100d52809269-delete_snapshot" released by "delete_snapshot" :: held 1.950s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-428567d2-dfd2-4f18-96a5-d513d036209a tempest-VolumeDependencyTests-200285121 None] Acquiring lock "cinder-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-428567d2-dfd2-4f18-96a5-d513d036209a tempest-VolumeDependencyTests-200285121 None] Lock "cinder-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-428567d2-dfd2-4f18-96a5-d513d036209a tempest-VolumeDependencyTests-200285121 None] Acquiring lock "cinder-quobyte-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-428567d2-dfd2-4f18-96a5-d513d036209a tempest-VolumeDependencyTests-200285121 None] Lock "cinder-quobyte-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e315ef64-5c27-463b-991a-0576c5cdd94f]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-428567d2-dfd2-4f18-96a5-d513d036209a tempest-VolumeDependencyTests-200285121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:03 devstack sudo[102473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac
Sep 07 18:14:03 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:14:03 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Flow 'volume_create_manager' (c5900eeb-362e-4541-8938-4469b5169b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0724a8-9aa6-4b11-92cc-063aa4f67baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-428567d2-dfd2-4f18-96a5-d513d036209a tempest-VolumeDependencyTests-200285121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac" returned: 0 in 0.462s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-428567d2-dfd2-4f18-96a5-d513d036209a tempest-VolumeDependencyTests-200285121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a0724a8-9aa6-4b11-92cc-063aa4f67baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-289450555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17c56f85-c4a5-471a-a509-c07da233140c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb09cedfca745dab47cf92c1d3898a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:04Z,use_quota=True,user_id='da34c9eebf464e388b6e737089242acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (557b29bc-d4da-4291-91d9-0f71e1ed6213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (557b29bc-d4da-4291-91d9-0f71e1ed6213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:03 devstack sudo[102478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac
Sep 07 18:14:03 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723f1366-89bf-4f4a-92df-3459f28aa6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723f1366-89bf-4f4a-92df-3459f28aa6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17c56f85-c4a5-471a-a509-c07da233140c', 'volume_name': 'volume-17c56f85-c4a5-471a-a509-c07da233140c', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04596e2f-956c-4e46-879b-db6b3fe87174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04596e2f-956c-4e46-879b-db6b3fe87174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc8fb1a-58b8-4e96-9b4d-2db01cd49e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:03 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Volume 17c56f85-c4a5-471a-a509-c07da233140c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17c56f85-c4a5-471a-a509-c07da233140c', 'volume_size': 1}
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-289450555',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17c56f85-c4a5-471a-a509-c07da233140c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb09cedfca745dab47cf92c1d3898a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:04Z,use_quota=True,user_id='da34c9eebf464e388b6e737089242acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Creating volume 17c56f85-c4a5-471a-a509-c07da233140c {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:14:03 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:14:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-17c56f85-c4a5-471a-a509-c07da233140c 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:03 devstack sudo[102480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-17c56f85-c4a5-471a-a509-c07da233140c 1073741824
Sep 07 18:14:03 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Flow 'volume_create_manager' (3f97580e-a1e7-4e9c-972a-2c6f9075cedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (719ad3b6-085d-4551-afca-c6779bceae68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (719ad3b6-085d-4551-afca-c6779bceae68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2072322485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1b1b894-3184-42f6-9771-b07a2482392a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb09cedfca745dab47cf92c1d3898a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:04Z,use_quota=True,user_id='da34c9eebf464e388b6e737089242acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1449652-7deb-40e1-a9be-0b337268415b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1449652-7deb-40e1-a9be-0b337268415b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:04 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (390547fa-bbd3-480b-9339-56c34924a915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (390547fa-bbd3-480b-9339-56c34924a915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1b1b894-3184-42f6-9771-b07a2482392a', 'volume_name': 'volume-f1b1b894-3184-42f6-9771-b07a2482392a', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749da612-7a9f-435b-b4dd-c99d1333a4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (749da612-7a9f-435b-b4dd-c99d1333a4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc683c98-9665-41a2-9193-1865375d399c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:04 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Volume f1b1b894-3184-42f6-9771-b07a2482392a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1b1b894-3184-42f6-9771-b07a2482392a', 'volume_size': 1}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-428567d2-dfd2-4f18-96a5-d513d036209a tempest-VolumeDependencyTests-200285121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac" returned: 0 in 0.481s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-428567d2-dfd2-4f18-96a5-d513d036209a tempest-VolumeDependencyTests-200285121 None] Lock "cinder-quobyte-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac" released by "delete_volume" :: held 1.018s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-428567d2-dfd2-4f18-96a5-d513d036209a tempest-VolumeDependencyTests-200285121 None] Created reservations ['08a2f576-c834-439d-a983-c021c065d8d6', 'ac8addb3-8f9c-42a1-a626-dcb120cc2f2a', '11d72c05-58b5-4a00-8709-a6fcfa7f6d97', '84cd4a08-f32e-4082-9c22-99ba91adf8de'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-428567d2-dfd2-4f18-96a5-d513d036209a tempest-VolumeDependencyTests-200285121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-428567d2-dfd2-4f18-96a5-d513d036209a tempest-VolumeDependencyTests-200285121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-428567d2-dfd2-4f18-96a5-d513d036209a tempest-VolumeDependencyTests-200285121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-428567d2-dfd2-4f18-96a5-d513d036209a tempest-VolumeDependencyTests-200285121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-428567d2-dfd2-4f18-96a5-d513d036209a tempest-VolumeDependencyTests-200285121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-428567d2-dfd2-4f18-96a5-d513d036209a tempest-VolumeDependencyTests-200285121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:04 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-17c56f85-c4a5-471a-a509-c07da233140c 1073741824" returned: 0 in 0.614s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:04 devstack sudo[102487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:14:04 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-17c56f85-c4a5-471a-a509-c07da233140c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:04 devstack sudo[102489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-17c56f85-c4a5-471a-a509-c07da233140c
Sep 07 18:14:04 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Flow 'volume_create_manager' (617ef634-d9b5-4bba-ab42-6d8a9b851eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4154835-b994-4a6f-8a6b-5548fa284c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4154835-b994-4a6f-8a6b-5548fa284c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1280920928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d385f5fa-5141-4060-9f66-e01bb3a7ee4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb09cedfca745dab47cf92c1d3898a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:05Z,use_quota=True,user_id='da34c9eebf464e388b6e737089242acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5aafa59-83bf-4fe6-859b-aba4ce060379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5aafa59-83bf-4fe6-859b-aba4ce060379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0765402d-fab4-4260-af5d-0eeffca8c414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0765402d-fab4-4260-af5d-0eeffca8c414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd385f5fa-5141-4060-9f66-e01bb3a7ee4d', 'volume_name': 'volume-d385f5fa-5141-4060-9f66-e01bb3a7ee4d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48a7ae6-6e20-4c3d-902d-3a72a8d0120e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48a7ae6-6e20-4c3d-902d-3a72a8d0120e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29e688b4-cfd4-4d12-8557-c166315a6cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:04 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Volume d385f5fa-5141-4060-9f66-e01bb3a7ee4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d385f5fa-5141-4060-9f66-e01bb3a7ee4d', 'volume_size': 1}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:04 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-428567d2-dfd2-4f18-96a5-d513d036209a tempest-VolumeDependencyTests-200285121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.361s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-428567d2-dfd2-4f18-96a5-d513d036209a tempest-VolumeDependencyTests-200285121 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:14:04 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-428567d2-dfd2-4f18-96a5-d513d036209a tempest-VolumeDependencyTests-200285121 None] Deleted volume successfully.
Sep 07 18:14:04 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-17c56f85-c4a5-471a-a509-c07da233140c" returned: 0 in 0.327s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.617s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2072322485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1b1b894-3184-42f6-9771-b07a2482392a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb09cedfca745dab47cf92c1d3898a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:04Z,use_quota=True,user_id='da34c9eebf464e388b6e737089242acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Creating volume f1b1b894-3184-42f6-9771-b07a2482392a {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:14:04 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f1b1b894-3184-42f6-9771-b07a2482392a 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc8fb1a-58b8-4e96-9b4d-2db01cd49e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17c56f85-c4a5-471a-a509-c07da233140c', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34e3b6d6-5b04-4503-b09b-4ea4f2a92966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:04 devstack sudo[102493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f1b1b894-3184-42f6-9771-b07a2482392a 1073741824
Sep 07 18:14:04 devstack sudo[102493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-428567d2-dfd2-4f18-96a5-d513d036209a tempest-VolumeDependencyTests-200285121 None] Lock "cinder-cbf4ef43-cb3d-4e7b-805b-3a9ed386ffac-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:04 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Volume volume-17c56f85-c4a5-471a-a509-c07da233140c (17c56f85-c4a5-471a-a509-c07da233140c): created successfully
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34e3b6d6-5b04-4503-b09b-4ea4f2a92966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Flow 'volume_create_manager' (c5900eeb-362e-4541-8938-4469b5169b0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:04 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-26d69f2e-5004-43b8-9938-3785fbd178a1 tempest-CreateVolumesFromSnapshotTest-291271286 None] Created volume successfully.
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Flow 'volume_create_manager' (51894dd3-41ef-470f-b0fd-9c0ea383342f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e675744-8365-49e2-8a85-0bf7e679ee8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e675744-8365-49e2-8a85-0bf7e679ee8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1352115163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f250ff7d-687e-4ef7-add8-1ee68317dbb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb09cedfca745dab47cf92c1d3898a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:05Z,use_quota=True,user_id='da34c9eebf464e388b6e737089242acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e70d1d5-6305-4d84-a08c-84520d1e9665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e70d1d5-6305-4d84-a08c-84520d1e9665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26e284a2-7a64-4dbb-87cc-1a18d989ef1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26e284a2-7a64-4dbb-87cc-1a18d989ef1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f250ff7d-687e-4ef7-add8-1ee68317dbb9', 'volume_name': 'volume-f250ff7d-687e-4ef7-add8-1ee68317dbb9', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d54b884a-04d1-46b5-8ab4-37b1f1a397e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d54b884a-04d1-46b5-8ab4-37b1f1a397e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e358cee4-11d2-4c36-b09e-8724ad982cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:05 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Volume f250ff7d-687e-4ef7-add8-1ee68317dbb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f250ff7d-687e-4ef7-add8-1ee68317dbb9', 'volume_size': 1}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:05 devstack sudo[102493]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f1b1b894-3184-42f6-9771-b07a2482392a 1073741824" returned: 0 in 0.583s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f1b1b894-3184-42f6-9771-b07a2482392a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-02918651-880b-46d6-9af6-72289bca782d tempest-VolumeDependencyTests-200285121 None] Acquiring lock "cinder-014be4c7-2e7c-42e1-8145-5b0275e7ac77-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:05 devstack sudo[102499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f1b1b894-3184-42f6-9771-b07a2482392a
Sep 07 18:14:05 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-02918651-880b-46d6-9af6-72289bca782d tempest-VolumeDependencyTests-200285121 None] Lock "cinder-014be4c7-2e7c-42e1-8145-5b0275e7ac77-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Flow 'volume_create_manager' (3df297b8-1941-4e3f-983e-a8a46c7bd071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b417acf-a823-41f3-b39f-f3db7d3a22c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b417acf-a823-41f3-b39f-f3db7d3a22c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-292714817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e1c4941-46a9-4632-9886-9edd0eb60552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb09cedfca745dab47cf92c1d3898a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:06Z,use_quota=True,user_id='da34c9eebf464e388b6e737089242acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13e3b45-519e-4045-955f-1382aafa5e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d13e3b45-519e-4045-955f-1382aafa5e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a023ae39-a571-4fa8-9ed9-b9a5f047a8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a023ae39-a571-4fa8-9ed9-b9a5f047a8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e1c4941-46a9-4632-9886-9edd0eb60552', 'volume_name': 'volume-2e1c4941-46a9-4632-9886-9edd0eb60552', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18feb539-83d1-4a0f-8d13-19af62da7072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18feb539-83d1-4a0f-8d13-19af62da7072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76b2dfa8-4b6d-49bf-acdd-b9d49508cec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:05 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Volume 2e1c4941-46a9-4632-9886-9edd0eb60552: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e1c4941-46a9-4632-9886-9edd0eb60552', 'volume_size': 1}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-02918651-880b-46d6-9af6-72289bca782d tempest-VolumeDependencyTests-200285121 None] Acquiring lock "cinder-quobyte-014be4c7-2e7c-42e1-8145-5b0275e7ac77" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-02918651-880b-46d6-9af6-72289bca782d tempest-VolumeDependencyTests-200285121 None] Lock "cinder-quobyte-014be4c7-2e7c-42e1-8145-5b0275e7ac77" acquired by "delete_volume" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afc89d9-724e-48fc-beee-2c9573ddb7fc]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02918651-880b-46d6-9af6-72289bca782d tempest-VolumeDependencyTests-200285121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-014be4c7-2e7c-42e1-8145-5b0275e7ac77 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:05 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f1b1b894-3184-42f6-9771-b07a2482392a" returned: 0 in 0.345s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.061s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1280920928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d385f5fa-5141-4060-9f66-e01bb3a7ee4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb09cedfca745dab47cf92c1d3898a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:05Z,use_quota=True,user_id='da34c9eebf464e388b6e737089242acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Creating volume d385f5fa-5141-4060-9f66-e01bb3a7ee4d {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:14:05 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d385f5fa-5141-4060-9f66-e01bb3a7ee4d 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc683c98-9665-41a2-9193-1865375d399c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1b1b894-3184-42f6-9771-b07a2482392a', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:05 devstack sudo[102503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d385f5fa-5141-4060-9f66-e01bb3a7ee4d 1073741824
Sep 07 18:14:05 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7dafb15-039d-4fab-a89a-5e41131089d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:05 devstack sudo[102502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-014be4c7-2e7c-42e1-8145-5b0275e7ac77
Sep 07 18:14:05 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:05 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Volume volume-f1b1b894-3184-42f6-9771-b07a2482392a (f1b1b894-3184-42f6-9771-b07a2482392a): created successfully
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7dafb15-039d-4fab-a89a-5e41131089d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Flow 'volume_create_manager' (3f97580e-a1e7-4e9c-972a-2c6f9075cedd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:05 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-68ee33f7-da31-4643-844b-70d2b295c37a tempest-CreateVolumesFromSnapshotTest-291271286 None] Created volume successfully.
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:14:06 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Flow 'volume_create_manager' (0a895072-3c13-47c7-939f-6ae5272aad86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba847a4e-6694-4672-aa4e-bacc13c4b7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02918651-880b-46d6-9af6-72289bca782d tempest-VolumeDependencyTests-200285121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-014be4c7-2e7c-42e1-8145-5b0275e7ac77" returned: 0 in 0.465s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02918651-880b-46d6-9af6-72289bca782d tempest-VolumeDependencyTests-200285121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-014be4c7-2e7c-42e1-8145-5b0275e7ac77 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba847a4e-6694-4672-aa4e-bacc13c4b7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-825068330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4226c983-4aef-4a79-8271-29e8c6efd044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7c904dc4524264a0069accd648b603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:06Z,use_quota=True,user_id='d4fcd2bfdd224b9a9afddf686373a00d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:06 devstack sudo[102514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-014be4c7-2e7c-42e1-8145-5b0275e7ac77
Sep 07 18:14:06 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0822ba6-6f16-4919-a2f6-33440e2cea30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0822ba6-6f16-4919-a2f6-33440e2cea30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1363f59-77f8-4f6f-a0a8-56833fd2d66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1363f59-77f8-4f6f-a0a8-56833fd2d66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4226c983-4aef-4a79-8271-29e8c6efd044', 'volume_name': 'volume-4226c983-4aef-4a79-8271-29e8c6efd044', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f348038d-6607-4bd7-8988-ab7c640db51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f348038d-6607-4bd7-8988-ab7c640db51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cba39c1-b4b7-4e4c-bbb0-6b9061fdeaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:06 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Volume 4226c983-4aef-4a79-8271-29e8c6efd044: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4226c983-4aef-4a79-8271-29e8c6efd044', 'volume_size': 1}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:06 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d385f5fa-5141-4060-9f66-e01bb3a7ee4d 1073741824" returned: 0 in 0.461s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d385f5fa-5141-4060-9f66-e01bb3a7ee4d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:06 devstack sudo[102516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d385f5fa-5141-4060-9f66-e01bb3a7ee4d
Sep 07 18:14:06 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:06 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02918651-880b-46d6-9af6-72289bca782d tempest-VolumeDependencyTests-200285121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-014be4c7-2e7c-42e1-8145-5b0275e7ac77" returned: 0 in 0.256s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-02918651-880b-46d6-9af6-72289bca782d tempest-VolumeDependencyTests-200285121 None] Lock "cinder-quobyte-014be4c7-2e7c-42e1-8145-5b0275e7ac77" released by "delete_volume" :: held 0.772s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-02918651-880b-46d6-9af6-72289bca782d tempest-VolumeDependencyTests-200285121 None] Created reservations ['b6b057d5-85d5-4ec7-9fed-8ae671c56cfa', '43ba09af-013b-4424-aa17-8a25bf31fd72', '5ca8675d-64e0-4340-b687-e8829308423e', 'fa2d20aa-0be1-40e2-85ff-f5c5e983a737'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:14:06 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d385f5fa-5141-4060-9f66-e01bb3a7ee4d" returned: 0 in 0.260s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.350s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1352115163',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f250ff7d-687e-4ef7-add8-1ee68317dbb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb09cedfca745dab47cf92c1d3898a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:05Z,use_quota=True,user_id='da34c9eebf464e388b6e737089242acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Creating volume f250ff7d-687e-4ef7-add8-1ee68317dbb9 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:14:06 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f250ff7d-687e-4ef7-add8-1ee68317dbb9 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:06 devstack sudo[102520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f250ff7d-687e-4ef7-add8-1ee68317dbb9 1073741824
Sep 07 18:14:06 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29e688b4-cfd4-4d12-8557-c166315a6cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d385f5fa-5141-4060-9f66-e01bb3a7ee4d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75129830-411f-4b17-bcf4-7effed81eeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-02918651-880b-46d6-9af6-72289bca782d tempest-VolumeDependencyTests-200285121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-02918651-880b-46d6-9af6-72289bca782d tempest-VolumeDependencyTests-200285121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-02918651-880b-46d6-9af6-72289bca782d tempest-VolumeDependencyTests-200285121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-02918651-880b-46d6-9af6-72289bca782d tempest-VolumeDependencyTests-200285121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-02918651-880b-46d6-9af6-72289bca782d tempest-VolumeDependencyTests-200285121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02918651-880b-46d6-9af6-72289bca782d tempest-VolumeDependencyTests-200285121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:06 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Volume volume-d385f5fa-5141-4060-9f66-e01bb3a7ee4d (d385f5fa-5141-4060-9f66-e01bb3a7ee4d): created successfully
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75129830-411f-4b17-bcf4-7effed81eeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Flow 'volume_create_manager' (617ef634-d9b5-4bba-ab42-6d8a9b851eef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:06 devstack sudo[102522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:14:06 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:06 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d245610e-1f87-4e3c-870a-fc5edbb61104 tempest-CreateVolumesFromSnapshotTest-291271286 None] Created volume successfully.
Sep 07 18:14:07 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-02918651-880b-46d6-9af6-72289bca782d tempest-VolumeDependencyTests-200285121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.322s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:07 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-02918651-880b-46d6-9af6-72289bca782d tempest-VolumeDependencyTests-200285121 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:14:07 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-02918651-880b-46d6-9af6-72289bca782d tempest-VolumeDependencyTests-200285121 None] Deleted volume successfully.
Sep 07 18:14:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-02918651-880b-46d6-9af6-72289bca782d tempest-VolumeDependencyTests-200285121 None] Lock "cinder-014be4c7-2e7c-42e1-8145-5b0275e7ac77-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:07 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f250ff7d-687e-4ef7-add8-1ee68317dbb9 1073741824" returned: 0 in 0.554s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f250ff7d-687e-4ef7-add8-1ee68317dbb9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:07 devstack sudo[102529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f250ff7d-687e-4ef7-add8-1ee68317dbb9
Sep 07 18:14:07 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:07 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f250ff7d-687e-4ef7-add8-1ee68317dbb9" returned: 0 in 0.251s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:14:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.737s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-292714817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e1c4941-46a9-4632-9886-9edd0eb60552,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdb09cedfca745dab47cf92c1d3898a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:06Z,use_quota=True,user_id='da34c9eebf464e388b6e737089242acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:14:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Creating volume 2e1c4941-46a9-4632-9886-9edd0eb60552 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:14:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:14:07 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:14:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2e1c4941-46a9-4632-9886-9edd0eb60552 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e358cee4-11d2-4c36-b09e-8724ad982cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f250ff7d-687e-4ef7-add8-1ee68317dbb9', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:07 devstack sudo[102532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2e1c4941-46a9-4632-9886-9edd0eb60552 1073741824
Sep 07 18:14:07 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70326d9c-4a46-4b41-9c0e-cd7e195687e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:07 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Volume volume-f250ff7d-687e-4ef7-add8-1ee68317dbb9 (f250ff7d-687e-4ef7-add8-1ee68317dbb9): created successfully
Sep 07 18:14:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70326d9c-4a46-4b41-9c0e-cd7e195687e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Flow 'volume_create_manager' (51894dd3-41ef-470f-b0fd-9c0ea383342f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:07 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5e6b9fbc-eb87-43a9-b670-169e4101a3b6 tempest-CreateVolumesFromSnapshotTest-291271286 None] Created volume successfully.
Sep 07 18:14:08 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2e1c4941-46a9-4632-9886-9edd0eb60552 1073741824" returned: 0 in 0.534s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2e1c4941-46a9-4632-9886-9edd0eb60552 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:08 devstack sudo[102573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2e1c4941-46a9-4632-9886-9edd0eb60552
Sep 07 18:14:08 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:08 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2e1c4941-46a9-4632-9886-9edd0eb60552" returned: 0 in 0.278s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:14:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.019s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-825068330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4226c983-4aef-4a79-8271-29e8c6efd044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7c904dc4524264a0069accd648b603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:06Z,use_quota=True,user_id='d4fcd2bfdd224b9a9afddf686373a00d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:14:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Creating volume 4226c983-4aef-4a79-8271-29e8c6efd044 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:14:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:14:08 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:14:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76b2dfa8-4b6d-49bf-acdd-b9d49508cec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e1c4941-46a9-4632-9886-9edd0eb60552', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90544c1-6bb6-4abb-9a14-8644e3044a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:08 devstack sudo[102578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044 1073741824
Sep 07 18:14:08 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:08 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Volume volume-2e1c4941-46a9-4632-9886-9edd0eb60552 (2e1c4941-46a9-4632-9886-9edd0eb60552): created successfully
Sep 07 18:14:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d90544c1-6bb6-4abb-9a14-8644e3044a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Flow 'volume_create_manager' (3df297b8-1941-4e3f-983e-a8a46c7bd071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:08 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-62e0b5c9-e65a-431d-9b51-99e7d2512c85 tempest-CreateVolumesFromSnapshotTest-291271286 None] Created volume successfully.
Sep 07 18:14:08 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044 1073741824" returned: 0 in 0.460s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:08 devstack sudo[102584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044
Sep 07 18:14:08 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:09 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044" returned: 0 in 0.264s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:14:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cba39c1-b4b7-4e4c-bbb0-6b9061fdeaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4226c983-4aef-4a79-8271-29e8c6efd044', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1917c99-e69f-493b-aef3-838ad5c0a223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-78fc673a-18a3-4532-b105-06d2203f2e95 tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "cinder-2e1c4941-46a9-4632-9886-9edd0eb60552-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:09 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Volume volume-4226c983-4aef-4a79-8271-29e8c6efd044 (4226c983-4aef-4a79-8271-29e8c6efd044): created successfully
Sep 07 18:14:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1917c99-e69f-493b-aef3-838ad5c0a223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Flow 'volume_create_manager' (0a895072-3c13-47c7-939f-6ae5272aad86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-78fc673a-18a3-4532-b105-06d2203f2e95 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-2e1c4941-46a9-4632-9886-9edd0eb60552-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:09 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-c7e498eb-471c-4f7b-9b5a-5aead2a97542 tempest-VolumesDeleteCascade-1951048962 None] Created volume successfully.
Sep 07 18:14:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-78fc673a-18a3-4532-b105-06d2203f2e95 tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "cinder-quobyte-2e1c4941-46a9-4632-9886-9edd0eb60552" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-78fc673a-18a3-4532-b105-06d2203f2e95 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-quobyte-2e1c4941-46a9-4632-9886-9edd0eb60552" acquired by "delete_volume" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:09 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[010d41ba-53c0-4bde-bab9-d098f25661fe]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-78fc673a-18a3-4532-b105-06d2203f2e95 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2e1c4941-46a9-4632-9886-9edd0eb60552 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:09 devstack sudo[102587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2e1c4941-46a9-4632-9886-9edd0eb60552
Sep 07 18:14:09 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fa899fb7-91be-4f7e-8614-974ace48b38d tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fa899fb7-91be-4f7e-8614-974ace48b38d tempest-VolumesDeleteCascade-1951048962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-fa899fb7-91be-4f7e-8614-974ace48b38d tempest-VolumesDeleteCascade-1951048962 None] Creating offline snapshot 96c9f10d-5ffa-4caa-a662-2af36f44b657 of volume 4226c983-4aef-4a79-8271-29e8c6efd044 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:14:09 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4015baf3-9f77-464b-bd9e-621172ac7768]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa899fb7-91be-4f7e-8614-974ace48b38d tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:09 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-78fc673a-18a3-4532-b105-06d2203f2e95 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2e1c4941-46a9-4632-9886-9edd0eb60552" returned: 0 in 0.389s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-78fc673a-18a3-4532-b105-06d2203f2e95 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2e1c4941-46a9-4632-9886-9edd0eb60552 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:09 devstack sudo[102593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2e1c4941-46a9-4632-9886-9edd0eb60552
Sep 07 18:14:09 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:09 devstack sudo[102592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044
Sep 07 18:14:09 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:09 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-78fc673a-18a3-4532-b105-06d2203f2e95 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2e1c4941-46a9-4632-9886-9edd0eb60552" returned: 0 in 0.270s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-78fc673a-18a3-4532-b105-06d2203f2e95 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-quobyte-2e1c4941-46a9-4632-9886-9edd0eb60552" released by "delete_volume" :: held 0.700s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:09 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-78fc673a-18a3-4532-b105-06d2203f2e95 tempest-CreateVolumesFromSnapshotTest-291271286 None] Created reservations ['21713237-b715-4c3c-8a15-88aaeabe001c', 'a0e65b60-a761-42a3-8428-f769d35b316d', '288024fc-da9f-4146-8f04-a6512d7525e2', 'f2d6a2be-41bf-4739-a943-8ccc22609e01'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:14:10 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa899fb7-91be-4f7e-8614-974ace48b38d tempest-VolumesDeleteCascade-1951048962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044" returned: 0 in 0.392s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa899fb7-91be-4f7e-8614-974ace48b38d tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:10 devstack sudo[102600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657 1G
Sep 07 18:14:10 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-78fc673a-18a3-4532-b105-06d2203f2e95 tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-78fc673a-18a3-4532-b105-06d2203f2e95 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-78fc673a-18a3-4532-b105-06d2203f2e95 tempest-CreateVolumesFromSnapshotTest-291271286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-78fc673a-18a3-4532-b105-06d2203f2e95 tempest-CreateVolumesFromSnapshotTest-291271286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-78fc673a-18a3-4532-b105-06d2203f2e95 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-78fc673a-18a3-4532-b105-06d2203f2e95 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:10 devstack sudo[102602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:14:10 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9f7ff4cc-1b4c-41f4-9eb3-2ae37c817fa2 tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "cinder-f250ff7d-687e-4ef7-add8-1ee68317dbb9-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9f7ff4cc-1b4c-41f4-9eb3-2ae37c817fa2 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-f250ff7d-687e-4ef7-add8-1ee68317dbb9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:10 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-78fc673a-18a3-4532-b105-06d2203f2e95 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.291s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:10 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-78fc673a-18a3-4532-b105-06d2203f2e95 tempest-CreateVolumesFromSnapshotTest-291271286 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:14:10 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-78fc673a-18a3-4532-b105-06d2203f2e95 tempest-CreateVolumesFromSnapshotTest-291271286 None] Deleted volume successfully.
Sep 07 18:14:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9f7ff4cc-1b4c-41f4-9eb3-2ae37c817fa2 tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "cinder-quobyte-f250ff7d-687e-4ef7-add8-1ee68317dbb9" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9f7ff4cc-1b4c-41f4-9eb3-2ae37c817fa2 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-quobyte-f250ff7d-687e-4ef7-add8-1ee68317dbb9" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-78fc673a-18a3-4532-b105-06d2203f2e95 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-2e1c4941-46a9-4632-9886-9edd0eb60552-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:10 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafd3698-d796-4b1a-9560-a28fe871a7e7]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9f7ff4cc-1b4c-41f4-9eb3-2ae37c817fa2 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f250ff7d-687e-4ef7-add8-1ee68317dbb9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:10 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa899fb7-91be-4f7e-8614-974ace48b38d tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657 1G" returned: 0 in 0.523s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa899fb7-91be-4f7e-8614-974ace48b38d tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4226c983-4aef-4a79-8271-29e8c6efd044 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:10 devstack sudo[102608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f250ff7d-687e-4ef7-add8-1ee68317dbb9
Sep 07 18:14:10 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:10 devstack sudo[102609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4226c983-4aef-4a79-8271-29e8c6efd044 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657
Sep 07 18:14:10 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:10 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9f7ff4cc-1b4c-41f4-9eb3-2ae37c817fa2 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f250ff7d-687e-4ef7-add8-1ee68317dbb9" returned: 0 in 0.440s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9f7ff4cc-1b4c-41f4-9eb3-2ae37c817fa2 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f250ff7d-687e-4ef7-add8-1ee68317dbb9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:10 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa899fb7-91be-4f7e-8614-974ace48b38d tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4226c983-4aef-4a79-8271-29e8c6efd044 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657" returned: 0 in 0.377s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:10 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-fa899fb7-91be-4f7e-8614-974ace48b38d tempest-VolumesDeleteCascade-1951048962 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657 is being set with open permissions: ugo+rw
Sep 07 18:14:10 devstack sudo[102619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f250ff7d-687e-4ef7-add8-1ee68317dbb9
Sep 07 18:14:10 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa899fb7-91be-4f7e-8614-974ace48b38d tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:10 devstack sudo[102621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657
Sep 07 18:14:10 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:11 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9f7ff4cc-1b4c-41f4-9eb3-2ae37c817fa2 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f250ff7d-687e-4ef7-add8-1ee68317dbb9" returned: 0 in 0.286s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9f7ff4cc-1b4c-41f4-9eb3-2ae37c817fa2 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-quobyte-f250ff7d-687e-4ef7-add8-1ee68317dbb9" released by "delete_volume" :: held 0.777s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:11 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa899fb7-91be-4f7e-8614-974ace48b38d tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657" returned: 0 in 0.281s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa899fb7-91be-4f7e-8614-974ace48b38d tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:11 devstack sudo[102625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.info
Sep 07 18:14:11 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:11 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-9f7ff4cc-1b4c-41f4-9eb3-2ae37c817fa2 tempest-CreateVolumesFromSnapshotTest-291271286 None] Created reservations ['ad1eb675-15ae-4abb-80ff-c8aa8e6842f3', '58a7b267-bfc8-4d7e-9e38-66dd3dfd0c4e', '2111b009-1778-4feb-b4ca-97c65d0897fc', 'f0343ad5-d9c1-45f3-80c6-4493d11fcc6b'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:14:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9f7ff4cc-1b4c-41f4-9eb3-2ae37c817fa2 tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9f7ff4cc-1b4c-41f4-9eb3-2ae37c817fa2 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9f7ff4cc-1b4c-41f4-9eb3-2ae37c817fa2 tempest-CreateVolumesFromSnapshotTest-291271286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9f7ff4cc-1b4c-41f4-9eb3-2ae37c817fa2 tempest-CreateVolumesFromSnapshotTest-291271286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9f7ff4cc-1b4c-41f4-9eb3-2ae37c817fa2 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9f7ff4cc-1b4c-41f4-9eb3-2ae37c817fa2 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:11 devstack sudo[102627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:14:11 devstack sudo[102627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:11 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa899fb7-91be-4f7e-8614-974ace48b38d tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.info" returned: 0 in 0.284s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:11 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-fa899fb7-91be-4f7e-8614-974ace48b38d tempest-VolumesDeleteCascade-1951048962 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.info is being set with open permissions: ugo+rw
Sep 07 18:14:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa899fb7-91be-4f7e-8614-974ace48b38d tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b9bbefc6-c754-49bc-a64d-2b201cb7e040 tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "cinder-d385f5fa-5141-4060-9f66-e01bb3a7ee4d-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:11 devstack sudo[102630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.info
Sep 07 18:14:11 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b9bbefc6-c754-49bc-a64d-2b201cb7e040 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-d385f5fa-5141-4060-9f66-e01bb3a7ee4d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b9bbefc6-c754-49bc-a64d-2b201cb7e040 tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "cinder-quobyte-d385f5fa-5141-4060-9f66-e01bb3a7ee4d" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b9bbefc6-c754-49bc-a64d-2b201cb7e040 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-quobyte-d385f5fa-5141-4060-9f66-e01bb3a7ee4d" acquired by "delete_volume" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:11 devstack sudo[102627]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9f7ff4cc-1b4c-41f4-9eb3-2ae37c817fa2 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.334s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:11 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-9f7ff4cc-1b4c-41f4-9eb3-2ae37c817fa2 tempest-CreateVolumesFromSnapshotTest-291271286 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:14:11 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9f7ff4cc-1b4c-41f4-9eb3-2ae37c817fa2 tempest-CreateVolumesFromSnapshotTest-291271286 None] Deleted volume successfully.
Sep 07 18:14:11 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a078bb-1bc1-4812-8a1c-5cad2473208e]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b9bbefc6-c754-49bc-a64d-2b201cb7e040 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d385f5fa-5141-4060-9f66-e01bb3a7ee4d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9f7ff4cc-1b4c-41f4-9eb3-2ae37c817fa2 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-f250ff7d-687e-4ef7-add8-1ee68317dbb9-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:11 devstack sudo[102633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d385f5fa-5141-4060-9f66-e01bb3a7ee4d
Sep 07 18:14:11 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:11 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fa899fb7-91be-4f7e-8614-974ace48b38d tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.info" returned: 0 in 0.341s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fa899fb7-91be-4f7e-8614-974ace48b38d tempest-VolumesDeleteCascade-1951048962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.294s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:11 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-fa899fb7-91be-4f7e-8614-974ace48b38d tempest-VolumesDeleteCascade-1951048962 None] Create snapshot completed successfully
Sep 07 18:14:12 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b9bbefc6-c754-49bc-a64d-2b201cb7e040 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d385f5fa-5141-4060-9f66-e01bb3a7ee4d" returned: 0 in 0.380s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b9bbefc6-c754-49bc-a64d-2b201cb7e040 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d385f5fa-5141-4060-9f66-e01bb3a7ee4d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:12 devstack sudo[102639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d385f5fa-5141-4060-9f66-e01bb3a7ee4d
Sep 07 18:14:12 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:12 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b9bbefc6-c754-49bc-a64d-2b201cb7e040 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d385f5fa-5141-4060-9f66-e01bb3a7ee4d" returned: 0 in 0.259s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b9bbefc6-c754-49bc-a64d-2b201cb7e040 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-quobyte-d385f5fa-5141-4060-9f66-e01bb3a7ee4d" released by "delete_volume" :: held 0.697s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:12 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-b9bbefc6-c754-49bc-a64d-2b201cb7e040 tempest-CreateVolumesFromSnapshotTest-291271286 None] Created reservations ['275900f8-36d6-4c2f-897f-cb1c6e38782f', '0f8fa84f-62d4-46fb-823f-e75f74ac1d46', '3b6f2f0f-b29c-4520-9981-603ce9cd1c9d', '5b703b49-4dc8-4634-9cf9-f5b82f3166e9'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:14:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b9bbefc6-c754-49bc-a64d-2b201cb7e040 tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b9bbefc6-c754-49bc-a64d-2b201cb7e040 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b9bbefc6-c754-49bc-a64d-2b201cb7e040 tempest-CreateVolumesFromSnapshotTest-291271286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b9bbefc6-c754-49bc-a64d-2b201cb7e040 tempest-CreateVolumesFromSnapshotTest-291271286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b9bbefc6-c754-49bc-a64d-2b201cb7e040 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b9bbefc6-c754-49bc-a64d-2b201cb7e040 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:12 devstack sudo[102642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:14:12 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:12 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b9bbefc6-c754-49bc-a64d-2b201cb7e040 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.274s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:12 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-b9bbefc6-c754-49bc-a64d-2b201cb7e040 tempest-CreateVolumesFromSnapshotTest-291271286 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:14:12 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b9bbefc6-c754-49bc-a64d-2b201cb7e040 tempest-CreateVolumesFromSnapshotTest-291271286 None] Deleted volume successfully.
Sep 07 18:14:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b3f129d5-51f7-4e5c-9f93-46106c533bed tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "cinder-f1b1b894-3184-42f6-9771-b07a2482392a-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b3f129d5-51f7-4e5c-9f93-46106c533bed tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-f1b1b894-3184-42f6-9771-b07a2482392a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b9bbefc6-c754-49bc-a64d-2b201cb7e040 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-d385f5fa-5141-4060-9f66-e01bb3a7ee4d-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b3f129d5-51f7-4e5c-9f93-46106c533bed tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "cinder-quobyte-f1b1b894-3184-42f6-9771-b07a2482392a" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b3f129d5-51f7-4e5c-9f93-46106c533bed tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-quobyte-f1b1b894-3184-42f6-9771-b07a2482392a" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:12 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59293fd-8fea-433b-8420-adf7a1d93114]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b3f129d5-51f7-4e5c-9f93-46106c533bed tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f1b1b894-3184-42f6-9771-b07a2482392a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:13 devstack sudo[102645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f1b1b894-3184-42f6-9771-b07a2482392a
Sep 07 18:14:13 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b984ac27-c874-45bd-add2-3d69b151615d tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b984ac27-c874-45bd-add2-3d69b151615d tempest-VolumesDeleteCascade-1951048962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-b984ac27-c874-45bd-add2-3d69b151615d tempest-VolumesDeleteCascade-1951048962 None] Creating offline snapshot f10070a3-0b84-4ac8-a23d-00fc3515b6b0 of volume 4226c983-4aef-4a79-8271-29e8c6efd044 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:14:13 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a3651f-f5e0-45b9-beb7-ffe2e8868ced]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b984ac27-c874-45bd-add2-3d69b151615d tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:13 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b3f129d5-51f7-4e5c-9f93-46106c533bed tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f1b1b894-3184-42f6-9771-b07a2482392a" returned: 0 in 0.390s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b3f129d5-51f7-4e5c-9f93-46106c533bed tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f1b1b894-3184-42f6-9771-b07a2482392a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:13 devstack sudo[102651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f1b1b894-3184-42f6-9771-b07a2482392a
Sep 07 18:14:13 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:13 devstack sudo[102650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657
Sep 07 18:14:13 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:13 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b3f129d5-51f7-4e5c-9f93-46106c533bed tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f1b1b894-3184-42f6-9771-b07a2482392a" returned: 0 in 0.266s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b3f129d5-51f7-4e5c-9f93-46106c533bed tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-quobyte-f1b1b894-3184-42f6-9771-b07a2482392a" released by "delete_volume" :: held 0.709s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:13 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-b3f129d5-51f7-4e5c-9f93-46106c533bed tempest-CreateVolumesFromSnapshotTest-291271286 None] Created reservations ['160dedcc-e055-4644-9401-2a3d3ee2bc06', '9c81afe3-67a5-4959-823b-13cd339b167b', '098b72c0-b92b-4401-9740-2866287b2256', '21809572-bf3a-4665-b4c8-d0541c1608c1'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:14:13 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b984ac27-c874-45bd-add2-3d69b151615d tempest-VolumesDeleteCascade-1951048962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657" returned: 0 in 0.391s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-b984ac27-c874-45bd-add2-3d69b151615d tempest-VolumesDeleteCascade-1951048962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4226c983-4aef-4a79-8271-29e8c6efd044(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:14:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b984ac27-c874-45bd-add2-3d69b151615d tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.f10070a3-0b84-4ac8-a23d-00fc3515b6b0 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:13 devstack sudo[102658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.f10070a3-0b84-4ac8-a23d-00fc3515b6b0 1G
Sep 07 18:14:13 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b3f129d5-51f7-4e5c-9f93-46106c533bed tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b3f129d5-51f7-4e5c-9f93-46106c533bed tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b3f129d5-51f7-4e5c-9f93-46106c533bed tempest-CreateVolumesFromSnapshotTest-291271286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b3f129d5-51f7-4e5c-9f93-46106c533bed tempest-CreateVolumesFromSnapshotTest-291271286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b3f129d5-51f7-4e5c-9f93-46106c533bed tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b3f129d5-51f7-4e5c-9f93-46106c533bed tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:13 devstack sudo[102660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:14:13 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6a982210-0635-477f-9372-8635509334fc tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "cinder-17c56f85-c4a5-471a-a509-c07da233140c-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6a982210-0635-477f-9372-8635509334fc tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-17c56f85-c4a5-471a-a509-c07da233140c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6a982210-0635-477f-9372-8635509334fc tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "cinder-quobyte-17c56f85-c4a5-471a-a509-c07da233140c" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:14 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b3f129d5-51f7-4e5c-9f93-46106c533bed tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.304s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:14 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-b3f129d5-51f7-4e5c-9f93-46106c533bed tempest-CreateVolumesFromSnapshotTest-291271286 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:14:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6a982210-0635-477f-9372-8635509334fc tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-quobyte-17c56f85-c4a5-471a-a509-c07da233140c" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:14 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b3f129d5-51f7-4e5c-9f93-46106c533bed tempest-CreateVolumesFromSnapshotTest-291271286 None] Deleted volume successfully.
Sep 07 18:14:14 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f507f6b1-18da-4a07-a48b-2ad274361321]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6a982210-0635-477f-9372-8635509334fc tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-17c56f85-c4a5-471a-a509-c07da233140c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b3f129d5-51f7-4e5c-9f93-46106c533bed tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-f1b1b894-3184-42f6-9771-b07a2482392a-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:14 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b984ac27-c874-45bd-add2-3d69b151615d tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.f10070a3-0b84-4ac8-a23d-00fc3515b6b0 1G" returned: 0 in 0.520s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b984ac27-c874-45bd-add2-3d69b151615d tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.f10070a3-0b84-4ac8-a23d-00fc3515b6b0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:14 devstack sudo[102668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.f10070a3-0b84-4ac8-a23d-00fc3515b6b0
Sep 07 18:14:14 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:14 devstack sudo[102667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-17c56f85-c4a5-471a-a509-c07da233140c
Sep 07 18:14:14 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:14 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6a982210-0635-477f-9372-8635509334fc tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-17c56f85-c4a5-471a-a509-c07da233140c" returned: 0 in 0.361s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6a982210-0635-477f-9372-8635509334fc tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-17c56f85-c4a5-471a-a509-c07da233140c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:14 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b984ac27-c874-45bd-add2-3d69b151615d tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.f10070a3-0b84-4ac8-a23d-00fc3515b6b0" returned: 0 in 0.288s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:14 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-b984ac27-c874-45bd-add2-3d69b151615d tempest-VolumesDeleteCascade-1951048962 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.f10070a3-0b84-4ac8-a23d-00fc3515b6b0 is being set with open permissions: ugo+rw
Sep 07 18:14:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b984ac27-c874-45bd-add2-3d69b151615d tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.f10070a3-0b84-4ac8-a23d-00fc3515b6b0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:14 devstack sudo[102677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-17c56f85-c4a5-471a-a509-c07da233140c
Sep 07 18:14:14 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:14 devstack sudo[102678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.f10070a3-0b84-4ac8-a23d-00fc3515b6b0
Sep 07 18:14:14 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:14 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6a982210-0635-477f-9372-8635509334fc tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-17c56f85-c4a5-471a-a509-c07da233140c" returned: 0 in 0.246s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:14 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6a982210-0635-477f-9372-8635509334fc tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-quobyte-17c56f85-c4a5-471a-a509-c07da233140c" released by "delete_volume" :: held 0.651s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b984ac27-c874-45bd-add2-3d69b151615d tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.f10070a3-0b84-4ac8-a23d-00fc3515b6b0" returned: 0 in 0.249s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b984ac27-c874-45bd-add2-3d69b151615d tempest-VolumesDeleteCascade-1951048962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.559s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:14 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b984ac27-c874-45bd-add2-3d69b151615d tempest-VolumesDeleteCascade-1951048962 None] Create snapshot completed successfully
Sep 07 18:14:14 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-6a982210-0635-477f-9372-8635509334fc tempest-CreateVolumesFromSnapshotTest-291271286 None] Created reservations ['a2537a73-0bbc-4347-81d8-7c330caadc07', 'e6975994-6bce-48b8-b93f-b720227c8362', '352c85c7-6d22-4ced-9ec3-02638cd33672', '0d346ac6-8597-4dbb-8314-164d459e5bd1'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:14:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6a982210-0635-477f-9372-8635509334fc tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6a982210-0635-477f-9372-8635509334fc tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6a982210-0635-477f-9372-8635509334fc tempest-CreateVolumesFromSnapshotTest-291271286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-6a982210-0635-477f-9372-8635509334fc tempest-CreateVolumesFromSnapshotTest-291271286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6a982210-0635-477f-9372-8635509334fc tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6a982210-0635-477f-9372-8635509334fc tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:14 devstack sudo[102683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:14:14 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:15 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6a982210-0635-477f-9372-8635509334fc tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.251s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-6a982210-0635-477f-9372-8635509334fc tempest-CreateVolumesFromSnapshotTest-291271286 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:14:15 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-6a982210-0635-477f-9372-8635509334fc tempest-CreateVolumesFromSnapshotTest-291271286 None] Deleted volume successfully.
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9ae5e68f-e6ed-4fc9-9caa-4c7236e3bb30 tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "cinder-24a31956-03d6-4789-b4f5-13800f7f87b3-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-6a982210-0635-477f-9372-8635509334fc tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-17c56f85-c4a5-471a-a509-c07da233140c-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9ae5e68f-e6ed-4fc9-9caa-4c7236e3bb30 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-24a31956-03d6-4789-b4f5-13800f7f87b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9ae5e68f-e6ed-4fc9-9caa-4c7236e3bb30 tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "cinder-quobyte-aa262765-067c-4706-ba4d-a0129831c09d" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9ae5e68f-e6ed-4fc9-9caa-4c7236e3bb30 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-quobyte-aa262765-067c-4706-ba4d-a0129831c09d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9ae5e68f-e6ed-4fc9-9caa-4c7236e3bb30 tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "cinder-quobyte-24a31956-03d6-4789-b4f5-13800f7f87b3" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "cinder-4226c983-4aef-4a79-8271-29e8c6efd044-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9ae5e68f-e6ed-4fc9-9caa-4c7236e3bb30 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-quobyte-24a31956-03d6-4789-b4f5-13800f7f87b3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9ae5e68f-e6ed-4fc9-9caa-4c7236e3bb30 tempest-CreateVolumesFromSnapshotTest-291271286 None] Deleting offline snapshot 24a31956-03d6-4789-b4f5-13800f7f87b3 of volume aa262765-067c-4706-ba4d-a0129831c09d {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9ae5e68f-e6ed-4fc9-9caa-4c7236e3bb30 tempest-CreateVolumesFromSnapshotTest-291271286 None] snapshot_file for this snap is: volume-aa262765-067c-4706-ba4d-a0129831c09d.24a31956-03d6-4789-b4f5-13800f7f87b3 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-4226c983-4aef-4a79-8271-29e8c6efd044-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7572d84e-8598-4a8c-902e-427e67a017c0]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9ae5e68f-e6ed-4fc9-9caa-4c7236e3bb30 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d.24a31956-03d6-4789-b4f5-13800f7f87b3 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Performing cascade delete. {{(pid=87269) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "cinder-96c9f10d-5ffa-4caa-a662-2af36f44b657-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-96c9f10d-5ffa-4caa-a662-2af36f44b657-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "cinder-quobyte-4226c983-4aef-4a79-8271-29e8c6efd044" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-quobyte-4226c983-4aef-4a79-8271-29e8c6efd044" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "cinder-quobyte-96c9f10d-5ffa-4caa-a662-2af36f44b657" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:15 devstack sudo[102686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d.24a31956-03d6-4789-b4f5-13800f7f87b3
Sep 07 18:14:15 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-quobyte-96c9f10d-5ffa-4caa-a662-2af36f44b657" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Deleting offline snapshot 96c9f10d-5ffa-4caa-a662-2af36f44b657 of volume 4226c983-4aef-4a79-8271-29e8c6efd044 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] snapshot_file for this snap is: volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a18407f-8042-4c17-8f23-5dbba3db75bc]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:15 devstack sudo[102688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657
Sep 07 18:14:15 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:15 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9ae5e68f-e6ed-4fc9-9caa-4c7236e3bb30 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d.24a31956-03d6-4789-b4f5-13800f7f87b3" returned: 0 in 0.364s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9ae5e68f-e6ed-4fc9-9caa-4c7236e3bb30 tempest-CreateVolumesFromSnapshotTest-291271286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa262765-067c-4706-ba4d-a0129831c09d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb79f7e-e6f7-40d3-8085-1b5b80ec8ec3]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9ae5e68f-e6ed-4fc9-9caa-4c7236e3bb30 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:15 devstack sudo[102693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d
Sep 07 18:14:15 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:15 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657" returned: 0 in 0.352s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4226c983-4aef-4a79-8271-29e8c6efd044(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[641979b0-4e9e-4648-b3af-b1fe57624674]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:15 devstack sudo[102698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044
Sep 07 18:14:15 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:16 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9ae5e68f-e6ed-4fc9-9caa-4c7236e3bb30 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d" returned: 0 in 0.364s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9ae5e68f-e6ed-4fc9-9caa-4c7236e3bb30 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d.24a31956-03d6-4789-b4f5-13800f7f87b3 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:16 devstack sudo[102703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d.24a31956-03d6-4789-b4f5-13800f7f87b3
Sep 07 18:14:16 devstack sudo[102703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:16 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044" returned: 0 in 0.356s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:16 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[345ee30b-7633-4fda-8645-5ce4c8bd2dff]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.f10070a3-0b84-4ac8-a23d-00fc3515b6b0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:16 devstack sudo[102708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.f10070a3-0b84-4ac8-a23d-00fc3515b6b0
Sep 07 18:14:16 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:16 devstack sudo[102703]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9ae5e68f-e6ed-4fc9-9caa-4c7236e3bb30 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d.24a31956-03d6-4789-b4f5-13800f7f87b3" returned: 0 in 0.349s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9ae5e68f-e6ed-4fc9-9caa-4c7236e3bb30 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d.24a31956-03d6-4789-b4f5-13800f7f87b3 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:16 devstack sudo[102714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d.24a31956-03d6-4789-b4f5-13800f7f87b3
Sep 07 18:14:16 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:16 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.f10070a3-0b84-4ac8-a23d-00fc3515b6b0" returned: 0 in 0.356s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4226c983-4aef-4a79-8271-29e8c6efd044(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:14:16 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c42843-d2ab-4f0e-984c-c9c0cce92a40]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:16 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9ae5e68f-e6ed-4fc9-9caa-4c7236e3bb30 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d.24a31956-03d6-4789-b4f5-13800f7f87b3" returned: 0 in 0.258s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9ae5e68f-e6ed-4fc9-9caa-4c7236e3bb30 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-quobyte-24a31956-03d6-4789-b4f5-13800f7f87b3" released by "_delete_snapshot" :: held 1.437s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:16 devstack sudo[102719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657
Sep 07 18:14:16 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9ae5e68f-e6ed-4fc9-9caa-4c7236e3bb30 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-quobyte-aa262765-067c-4706-ba4d-a0129831c09d" released by "delete_snapshot" :: held 1.467s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:16 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-9ae5e68f-e6ed-4fc9-9caa-4c7236e3bb30 tempest-CreateVolumesFromSnapshotTest-291271286 None] Created reservations ['1408bae3-1777-4a15-b236-0bb12213fe45', '1098da02-7374-48c4-8c71-d13b031c5a9e', '50848758-1a5f-4235-8186-1e839235a91a', '072af7a6-036a-4cb3-b4e3-3b26383f4c00'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:14:16 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9ae5e68f-e6ed-4fc9-9caa-4c7236e3bb30 tempest-CreateVolumesFromSnapshotTest-291271286 None] Delete snapshot completed successfully.
Sep 07 18:14:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9ae5e68f-e6ed-4fc9-9caa-4c7236e3bb30 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-24a31956-03d6-4789-b4f5-13800f7f87b3-delete_snapshot" released by "delete_snapshot" :: held 1.600s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:16 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657" returned: 0 in 0.345s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4226c983-4aef-4a79-8271-29e8c6efd044(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:14:16 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[234a6a05-9b7c-4e64-97c4-8bfa0e37ca73]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:17 devstack sudo[102725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044
Sep 07 18:14:17 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:17 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044" returned: 0 in 0.340s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:17 devstack sudo[102730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657
Sep 07 18:14:17 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f9e6dc85-bec5-4f29-aeba-ecee4411f456 tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "cinder-aa262765-067c-4706-ba4d-a0129831c09d-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f9e6dc85-bec5-4f29-aeba-ecee4411f456 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-aa262765-067c-4706-ba4d-a0129831c09d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f9e6dc85-bec5-4f29-aeba-ecee4411f456 tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "cinder-quobyte-aa262765-067c-4706-ba4d-a0129831c09d" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f9e6dc85-bec5-4f29-aeba-ecee4411f456 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-quobyte-aa262765-067c-4706-ba4d-a0129831c09d" acquired by "delete_volume" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:17 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93e7785-0d7b-4eb7-b0d5-868390cd67c2]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f9e6dc85-bec5-4f29-aeba-ecee4411f456 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:17 devstack sudo[102732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d
Sep 07 18:14:17 devstack sudo[102732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:17 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657" returned: 0 in 0.325s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:17 devstack sudo[102737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657
Sep 07 18:14:17 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:17 devstack sudo[102732]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f9e6dc85-bec5-4f29-aeba-ecee4411f456 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d" returned: 0 in 0.358s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f9e6dc85-bec5-4f29-aeba-ecee4411f456 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:17 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.96c9f10d-5ffa-4caa-a662-2af36f44b657" returned: 0 in 0.251s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4226c983-4aef-4a79-8271-29e8c6efd044 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.f10070a3-0b84-4ac8-a23d-00fc3515b6b0 -F qcow2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:17 devstack sudo[102743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d
Sep 07 18:14:17 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:17 devstack sudo[102745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4226c983-4aef-4a79-8271-29e8c6efd044 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.f10070a3-0b84-4ac8-a23d-00fc3515b6b0 -F qcow2
Sep 07 18:14:17 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:18 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f9e6dc85-bec5-4f29-aeba-ecee4411f456 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aa262765-067c-4706-ba4d-a0129831c09d" returned: 0 in 0.250s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f9e6dc85-bec5-4f29-aeba-ecee4411f456 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-quobyte-aa262765-067c-4706-ba4d-a0129831c09d" released by "delete_volume" :: held 0.660s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-f9e6dc85-bec5-4f29-aeba-ecee4411f456 tempest-CreateVolumesFromSnapshotTest-291271286 None] Created reservations ['cdfe982d-2abf-44de-9d57-0457e440c66a', '536b3c03-a624-48e6-8614-466a6274c4bc', '67a5fd80-49cb-4711-b608-64169a0c8b22', 'f97a142d-1dba-4d86-b196-25ec5911c93d'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:14:18 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4226c983-4aef-4a79-8271-29e8c6efd044 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.f10070a3-0b84-4ac8-a23d-00fc3515b6b0 -F qcow2" returned: 0 in 0.315s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-quobyte-96c9f10d-5ffa-4caa-a662-2af36f44b657" released by "_delete_snapshot" :: held 2.798s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-quobyte-4226c983-4aef-4a79-8271-29e8c6efd044" released by "delete_snapshot" :: held 2.824s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f9e6dc85-bec5-4f29-aeba-ecee4411f456 tempest-CreateVolumesFromSnapshotTest-291271286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f9e6dc85-bec5-4f29-aeba-ecee4411f456 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f9e6dc85-bec5-4f29-aeba-ecee4411f456 tempest-CreateVolumesFromSnapshotTest-291271286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f9e6dc85-bec5-4f29-aeba-ecee4411f456 tempest-CreateVolumesFromSnapshotTest-291271286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f9e6dc85-bec5-4f29-aeba-ecee4411f456 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f9e6dc85-bec5-4f29-aeba-ecee4411f456 tempest-CreateVolumesFromSnapshotTest-291271286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:18 devstack sudo[102752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:14:18 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Created reservations ['2544cb75-af1f-4286-9210-983b2f545a10', 'a0d1ac59-3d6b-47ce-8a03-b37a9d920f38', 'f393efd5-6972-4534-8501-79ddd3936b9d', '153682ce-e48f-42e6-800d-b69628f6ba13'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:14:18 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Delete snapshot completed successfully.
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-96c9f10d-5ffa-4caa-a662-2af36f44b657-delete_snapshot" released by "delete_snapshot" :: held 2.999s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "cinder-f10070a3-0b84-4ac8-a23d-00fc3515b6b0-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-f10070a3-0b84-4ac8-a23d-00fc3515b6b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "cinder-quobyte-4226c983-4aef-4a79-8271-29e8c6efd044" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-quobyte-4226c983-4aef-4a79-8271-29e8c6efd044" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "cinder-quobyte-f10070a3-0b84-4ac8-a23d-00fc3515b6b0" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-quobyte-f10070a3-0b84-4ac8-a23d-00fc3515b6b0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Deleting offline snapshot f10070a3-0b84-4ac8-a23d-00fc3515b6b0 of volume 4226c983-4aef-4a79-8271-29e8c6efd044 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] snapshot_file for this snap is: volume-4226c983-4aef-4a79-8271-29e8c6efd044.f10070a3-0b84-4ac8-a23d-00fc3515b6b0 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cac1a2-cdf1-46dc-a759-065b7c41918c]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.f10070a3-0b84-4ac8-a23d-00fc3515b6b0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:18 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f9e6dc85-bec5-4f29-aeba-ecee4411f456 tempest-CreateVolumesFromSnapshotTest-291271286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.261s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f9e6dc85-bec5-4f29-aeba-ecee4411f456 tempest-CreateVolumesFromSnapshotTest-291271286 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:14:18 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f9e6dc85-bec5-4f29-aeba-ecee4411f456 tempest-CreateVolumesFromSnapshotTest-291271286 None] Deleted volume successfully.
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f9e6dc85-bec5-4f29-aeba-ecee4411f456 tempest-CreateVolumesFromSnapshotTest-291271286 None] Lock "cinder-aa262765-067c-4706-ba4d-a0129831c09d-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:18 devstack sudo[102755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.f10070a3-0b84-4ac8-a23d-00fc3515b6b0
Sep 07 18:14:18 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:18 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.f10070a3-0b84-4ac8-a23d-00fc3515b6b0" returned: 0 in 0.385s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4226c983-4aef-4a79-8271-29e8c6efd044(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e4ad20-4760-4b64-9932-3e4eba4b3ac1]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:18 devstack sudo[102765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044
Sep 07 18:14:18 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:19 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044" returned: 0 in 0.391s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.f10070a3-0b84-4ac8-a23d-00fc3515b6b0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:19 devstack sudo[102770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.f10070a3-0b84-4ac8-a23d-00fc3515b6b0
Sep 07 18:14:19 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:19 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.f10070a3-0b84-4ac8-a23d-00fc3515b6b0" returned: 0 in 0.415s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.f10070a3-0b84-4ac8-a23d-00fc3515b6b0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:19 devstack sudo[102776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.f10070a3-0b84-4ac8-a23d-00fc3515b6b0
Sep 07 18:14:19 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:19 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044.f10070a3-0b84-4ac8-a23d-00fc3515b6b0" returned: 0 in 0.261s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-quobyte-f10070a3-0b84-4ac8-a23d-00fc3515b6b0" released by "_delete_snapshot" :: held 1.558s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-quobyte-4226c983-4aef-4a79-8271-29e8c6efd044" released by "delete_snapshot" :: held 1.579s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:20 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Created reservations ['a09b089e-ade3-408c-b3b4-411a884108f3', 'ba019a53-5ba4-481a-aad0-399bd3104150', '416bbeb7-38af-42f1-b813-6d8078ed2999', '635de4b6-6ae0-4cce-9c7c-490260437ee8'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:14:20 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Delete snapshot completed successfully.
Sep 07 18:14:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-f10070a3-0b84-4ac8-a23d-00fc3515b6b0-delete_snapshot" released by "delete_snapshot" :: held 1.724s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Snapshots deleted, issuing volume delete {{(pid=87269) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 07 18:14:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "cinder-quobyte-4226c983-4aef-4a79-8271-29e8c6efd044" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-quobyte-4226c983-4aef-4a79-8271-29e8c6efd044" acquired by "delete_volume" :: waited 0.012s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:20 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b8d8c1-5a05-423a-af48-d2d5bcaca3aa]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:20 devstack sudo[102779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044
Sep 07 18:14:20 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:20 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044" returned: 0 in 0.381s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:20 devstack sudo[102785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044
Sep 07 18:14:20 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:20 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-4226c983-4aef-4a79-8271-29e8c6efd044" returned: 0 in 0.253s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-quobyte-4226c983-4aef-4a79-8271-29e8c6efd044" released by "delete_volume" :: held 0.700s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:20 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Created reservations ['a93fd2b6-f372-4eb1-a964-d1ea837cf9d7', '1d1e7ff1-eac4-404e-82cb-3b7e313df7c7', 'b1ff0a9b-5fed-44fc-91d6-2bb44f45a2e3', 'c74e0b63-d644-4e71-92b0-6c2ee316fc70'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:14:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:20 devstack sudo[102789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:14:20 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:21 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.254s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:21 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:14:21 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Deleted volume successfully.
Sep 07 18:14:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9c4b71ea-6104-4d99-a03d-d9eb328bdacf tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-4226c983-4aef-4a79-8271-29e8c6efd044-delete_volume" released by "delete_volume" :: held 5.949s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:21 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:14:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Flow 'volume_create_manager' (90a92b38-a7e9-48a3-add0-1020d8c7b039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a1c96c-0d0f-48b8-a09a-99441a3a2837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a1c96c-0d0f-48b8-a09a-99441a3a2837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1239985682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eecf2238-bc25-42af-8c69-1353295b8500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf52d5a40a294309a6b81b8bf08fb288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:21Z,use_quota=True,user_id='08e488b9926a4b8b8a51172711390c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec59448-180a-4a32-801b-58f376aff475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec59448-180a-4a32-801b-58f376aff475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcbdfe38-8af3-4a0d-b424-9a971591a458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcbdfe38-8af3-4a0d-b424-9a971591a458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eecf2238-bc25-42af-8c69-1353295b8500', 'volume_name': 'volume-eecf2238-bc25-42af-8c69-1353295b8500', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b6b228-2e63-429d-a842-1a5717a606a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64b6b228-2e63-429d-a842-1a5717a606a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262a4a54-e653-4eca-8727-8bcee9b7fc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:21 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Volume eecf2238-bc25-42af-8c69-1353295b8500: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eecf2238-bc25-42af-8c69-1353295b8500', 'volume_size': 1}
Sep 07 18:14:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1239985682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eecf2238-bc25-42af-8c69-1353295b8500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf52d5a40a294309a6b81b8bf08fb288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:21Z,use_quota=True,user_id='08e488b9926a4b8b8a51172711390c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:14:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Creating volume eecf2238-bc25-42af-8c69-1353295b8500 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:14:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:14:21 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:14:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-eecf2238-bc25-42af-8c69-1353295b8500 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:21 devstack sudo[102792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-eecf2238-bc25-42af-8c69-1353295b8500 1073741824
Sep 07 18:14:21 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:21 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-eecf2238-bc25-42af-8c69-1353295b8500 1073741824" returned: 0 in 0.419s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-eecf2238-bc25-42af-8c69-1353295b8500 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:21 devstack sudo[102799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-eecf2238-bc25-42af-8c69-1353295b8500
Sep 07 18:14:21 devstack sudo[102799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:22 devstack sudo[102799]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-eecf2238-bc25-42af-8c69-1353295b8500" returned: 0 in 0.240s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (262a4a54-e653-4eca-8727-8bcee9b7fc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eecf2238-bc25-42af-8c69-1353295b8500', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1855eb8c-479a-4350-905b-ee490448188b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:22 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Volume volume-eecf2238-bc25-42af-8c69-1353295b8500 (eecf2238-bc25-42af-8c69-1353295b8500): created successfully
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1855eb8c-479a-4350-905b-ee490448188b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Flow 'volume_create_manager' (90a92b38-a7e9-48a3-add0-1020d8c7b039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:22 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-7e3b04c0-733e-4511-9048-8045cbf3d261 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Created volume successfully.
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Flow 'volume_create_manager' (c6d46b16-4afd-4513-a205-33a1412ef4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0fb002-4e77-48b9-8e95-904b946e56db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c0fb002-4e77-48b9-8e95-904b946e56db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1544959782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe401c0-0e8f-467f-a393-2cd5691ac630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7c904dc4524264a0069accd648b603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:22Z,use_quota=True,user_id='d4fcd2bfdd224b9a9afddf686373a00d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c13247c-5ee3-4987-bd3d-af6688588da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c13247c-5ee3-4987-bd3d-af6688588da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (048e5496-24a2-4735-94d5-296e475059be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (048e5496-24a2-4735-94d5-296e475059be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fe401c0-0e8f-467f-a393-2cd5691ac630', 'volume_name': 'volume-1fe401c0-0e8f-467f-a393-2cd5691ac630', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa1d1548-bb83-45ad-add9-c7691bdc6f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa1d1548-bb83-45ad-add9-c7691bdc6f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f00bce-221d-443c-a378-901ee156b405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:22 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Volume 1fe401c0-0e8f-467f-a393-2cd5691ac630: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fe401c0-0e8f-467f-a393-2cd5691ac630', 'volume_size': 1}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1544959782',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe401c0-0e8f-467f-a393-2cd5691ac630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7c904dc4524264a0069accd648b603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:22Z,use_quota=True,user_id='d4fcd2bfdd224b9a9afddf686373a00d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Creating volume 1fe401c0-0e8f-467f-a393-2cd5691ac630 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:14:22 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:22 devstack sudo[102802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630 1073741824
Sep 07 18:14:22 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Flow 'volume_create_manager' (30c812fc-601d-489f-9cec-354879e294b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd90550-e2ca-47ee-911a-1c72cdafc87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd90550-e2ca-47ee-911a-1c72cdafc87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1903852645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79b0677-2a01-4d61-947f-ef787a4a6197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf52d5a40a294309a6b81b8bf08fb288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:23Z,use_quota=True,user_id='08e488b9926a4b8b8a51172711390c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c6bee9-331d-44bd-99ef-591b3ba4f11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c6bee9-331d-44bd-99ef-591b3ba4f11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d0c99d-2e70-4136-ab45-caed2e4e95a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d0c99d-2e70-4136-ab45-caed2e4e95a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f79b0677-2a01-4d61-947f-ef787a4a6197', 'volume_name': 'volume-f79b0677-2a01-4d61-947f-ef787a4a6197', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234fa6f8-121c-4d67-9d1e-409b33757d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234fa6f8-121c-4d67-9d1e-409b33757d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198a7b83-220c-4e05-ab2f-49d318efffcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:22 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Volume f79b0677-2a01-4d61-947f-ef787a4a6197: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f79b0677-2a01-4d61-947f-ef787a4a6197', 'volume_size': 1}
Sep 07 18:14:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:23 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630 1073741824" returned: 0 in 0.488s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:23 devstack sudo[102808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630
Sep 07 18:14:23 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Flow 'volume_create_manager' (c2992b52-afdd-4347-9e9d-695e25ba4b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467bfe39-0f7e-4193-9744-4ca14106d2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467bfe39-0f7e-4193-9744-4ca14106d2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1347329722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b44a837e-7081-48b2-a130-c64634ebf855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf52d5a40a294309a6b81b8bf08fb288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:23Z,use_quota=True,user_id='08e488b9926a4b8b8a51172711390c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84aeeae2-2b5c-41f2-9c64-bcd6b5effdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84aeeae2-2b5c-41f2-9c64-bcd6b5effdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318f0043-ea71-453c-bb1c-55789dc4ec11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318f0043-ea71-453c-bb1c-55789dc4ec11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b44a837e-7081-48b2-a130-c64634ebf855', 'volume_name': 'volume-b44a837e-7081-48b2-a130-c64634ebf855', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abcc8d8a-26bd-41dd-a0be-b90e3ee6eb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abcc8d8a-26bd-41dd-a0be-b90e3ee6eb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:23 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e983a0b-2b48-4eaf-b0f6-86e470cd341c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:23 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Volume b44a837e-7081-48b2-a130-c64634ebf855: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b44a837e-7081-48b2-a130-c64634ebf855', 'volume_size': 1}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630" returned: 0 in 0.264s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.419s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1903852645',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f79b0677-2a01-4d61-947f-ef787a4a6197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf52d5a40a294309a6b81b8bf08fb288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:23Z,use_quota=True,user_id='08e488b9926a4b8b8a51172711390c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Creating volume f79b0677-2a01-4d61-947f-ef787a4a6197 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:14:23 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f79b0677-2a01-4d61-947f-ef787a4a6197 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03f00bce-221d-443c-a378-901ee156b405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fe401c0-0e8f-467f-a393-2cd5691ac630', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53339694-1590-4dcb-8847-9ffc7a047150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:23 devstack sudo[102811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f79b0677-2a01-4d61-947f-ef787a4a6197 1073741824
Sep 07 18:14:23 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:23 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Volume volume-1fe401c0-0e8f-467f-a393-2cd5691ac630 (1fe401c0-0e8f-467f-a393-2cd5691ac630): created successfully
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53339694-1590-4dcb-8847-9ffc7a047150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Flow 'volume_create_manager' (c6d46b16-4afd-4513-a205-33a1412ef4ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:23 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-848c2129-20ab-4a67-8076-0c01f0f34b40 tempest-VolumesDeleteCascade-1951048962 None] Created volume successfully.
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Flow 'volume_create_manager' (1309ffb6-48a1-427c-943a-3163d6df0797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b27eb7b0-a621-4726-8635-a4fafae19396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b27eb7b0-a621-4726-8635-a4fafae19396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1173281871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f062c610-5ddb-4800-8f6c-ac969d47ed92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf52d5a40a294309a6b81b8bf08fb288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:24Z,use_quota=True,user_id='08e488b9926a4b8b8a51172711390c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d379db5e-ce94-41c5-8a8e-0b0d66473498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d379db5e-ce94-41c5-8a8e-0b0d66473498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c08be2-5e1b-49b6-b3d5-5f60cf242cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c08be2-5e1b-49b6-b3d5-5f60cf242cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f062c610-5ddb-4800-8f6c-ac969d47ed92', 'volume_name': 'volume-f062c610-5ddb-4800-8f6c-ac969d47ed92', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ead012c2-04b8-4e02-b1db-41e2970d599e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ead012c2-04b8-4e02-b1db-41e2970d599e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d7e0ba-c254-4a51-9f5f-7d428244849e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:23 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Volume f062c610-5ddb-4800-8f6c-ac969d47ed92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f062c610-5ddb-4800-8f6c-ac969d47ed92', 'volume_size': 1}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:23 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f79b0677-2a01-4d61-947f-ef787a4a6197 1073741824" returned: 0 in 0.498s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f79b0677-2a01-4d61-947f-ef787a4a6197 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:23 devstack sudo[102823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f79b0677-2a01-4d61-947f-ef787a4a6197
Sep 07 18:14:23 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Flow 'volume_create_manager' (09a9f1ef-e00d-41fc-9757-13f7339838e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:23 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5353db5-ebc2-4f7c-8da9-100cd6c69b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5353db5-ebc2-4f7c-8da9-100cd6c69b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-726088097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09027867-a38f-4d67-84fa-d85dbcd0a826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf52d5a40a294309a6b81b8bf08fb288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:24Z,use_quota=True,user_id='08e488b9926a4b8b8a51172711390c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ee79d1-380c-44f3-8a6b-6177ace01dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ee79d1-380c-44f3-8a6b-6177ace01dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc86ae22-11a0-42be-9a97-a0aa5ca5699e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc86ae22-11a0-42be-9a97-a0aa5ca5699e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09027867-a38f-4d67-84fa-d85dbcd0a826', 'volume_name': 'volume-09027867-a38f-4d67-84fa-d85dbcd0a826', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8216147b-11ed-4cd7-8f3f-2a07b5acfa65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8216147b-11ed-4cd7-8f3f-2a07b5acfa65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c04ece0-09e7-449a-b325-5aefc7508cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:24 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Volume 09027867-a38f-4d67-84fa-d85dbcd0a826: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09027867-a38f-4d67-84fa-d85dbcd0a826', 'volume_size': 1}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:24 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f79b0677-2a01-4d61-947f-ef787a4a6197" returned: 0 in 0.264s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.842s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1347329722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b44a837e-7081-48b2-a130-c64634ebf855,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf52d5a40a294309a6b81b8bf08fb288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:23Z,use_quota=True,user_id='08e488b9926a4b8b8a51172711390c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Creating volume b44a837e-7081-48b2-a130-c64634ebf855 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:14:24 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b44a837e-7081-48b2-a130-c64634ebf855 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:24 devstack sudo[102826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b44a837e-7081-48b2-a130-c64634ebf855 1073741824
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (198a7b83-220c-4e05-ab2f-49d318efffcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f79b0677-2a01-4d61-947f-ef787a4a6197', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:24 devstack sudo[102826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d753d110-4ea2-44e7-9988-c11a7fb3a495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:24 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Volume volume-f79b0677-2a01-4d61-947f-ef787a4a6197 (f79b0677-2a01-4d61-947f-ef787a4a6197): created successfully
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d753d110-4ea2-44e7-9988-c11a7fb3a495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Flow 'volume_create_manager' (30c812fc-601d-489f-9cec-354879e294b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:24 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ee983169-751a-48a6-b4bf-96823bdd37a0 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Created volume successfully.
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Flow 'volume_create_manager' (b635c979-2e47-4061-b9cd-cf60b2cc5e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce890d8-952d-4ca9-b0e6-ee2f1437d3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dce890d8-952d-4ca9-b0e6-ee2f1437d3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-667087666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb1cee2-ccbd-4158-805b-083220bbea25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf52d5a40a294309a6b81b8bf08fb288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:24Z,use_quota=True,user_id='08e488b9926a4b8b8a51172711390c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1273739a-2cf9-41cb-bc96-b020fe3cc729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1273739a-2cf9-41cb-bc96-b020fe3cc729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0983e2-5db2-42c9-95e3-8f1d631971ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0983e2-5db2-42c9-95e3-8f1d631971ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdb1cee2-ccbd-4158-805b-083220bbea25', 'volume_name': 'volume-fdb1cee2-ccbd-4158-805b-083220bbea25', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b152789-203f-46b6-ac0c-bdacd2ae44b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b152789-203f-46b6-ac0c-bdacd2ae44b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c0772f-30dc-475d-aea8-c71f15360fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:24 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Volume fdb1cee2-ccbd-4158-805b-083220bbea25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdb1cee2-ccbd-4158-805b-083220bbea25', 'volume_size': 1}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:24 devstack sudo[102826]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b44a837e-7081-48b2-a130-c64634ebf855 1073741824" returned: 0 in 0.450s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b44a837e-7081-48b2-a130-c64634ebf855 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:24 devstack sudo[102832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b44a837e-7081-48b2-a130-c64634ebf855
Sep 07 18:14:24 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-80751cb3-7d9c-4433-a545-de0791627ff4 tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:24 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b44a837e-7081-48b2-a130-c64634ebf855" returned: 0 in 0.245s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.232s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1173281871',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f062c610-5ddb-4800-8f6c-ac969d47ed92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf52d5a40a294309a6b81b8bf08fb288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:24Z,use_quota=True,user_id='08e488b9926a4b8b8a51172711390c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Creating volume f062c610-5ddb-4800-8f6c-ac969d47ed92 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:14:24 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f062c610-5ddb-4800-8f6c-ac969d47ed92 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e983a0b-2b48-4eaf-b0f6-86e470cd341c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b44a837e-7081-48b2-a130-c64634ebf855', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:24 devstack sudo[102835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f062c610-5ddb-4800-8f6c-ac969d47ed92 1073741824
Sep 07 18:14:24 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b07bbc-1844-4f84-a440-4c811c63e387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:24 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Volume volume-b44a837e-7081-48b2-a130-c64634ebf855 (b44a837e-7081-48b2-a130-c64634ebf855): created successfully
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b07bbc-1844-4f84-a440-4c811c63e387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Flow 'volume_create_manager' (c2992b52-afdd-4347-9e9d-695e25ba4b23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:24 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-47eb2b88-3f3e-477e-957c-8070b104f575 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Created volume successfully.
Sep 07 18:14:25 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f062c610-5ddb-4800-8f6c-ac969d47ed92 1073741824" returned: 0 in 0.417s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f062c610-5ddb-4800-8f6c-ac969d47ed92 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:25 devstack sudo[102841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f062c610-5ddb-4800-8f6c-ac969d47ed92
Sep 07 18:14:25 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:25 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f062c610-5ddb-4800-8f6c-ac969d47ed92" returned: 0 in 0.240s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:14:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.568s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-726088097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09027867-a38f-4d67-84fa-d85dbcd0a826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf52d5a40a294309a6b81b8bf08fb288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:24Z,use_quota=True,user_id='08e488b9926a4b8b8a51172711390c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:14:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Creating volume 09027867-a38f-4d67-84fa-d85dbcd0a826 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:14:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:14:25 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:14:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-09027867-a38f-4d67-84fa-d85dbcd0a826 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d7e0ba-c254-4a51-9f5f-7d428244849e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f062c610-5ddb-4800-8f6c-ac969d47ed92', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:25 devstack sudo[102844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-09027867-a38f-4d67-84fa-d85dbcd0a826 1073741824
Sep 07 18:14:25 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e829d2-f916-4f76-9068-757c1ed81a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:25 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Volume volume-f062c610-5ddb-4800-8f6c-ac969d47ed92 (f062c610-5ddb-4800-8f6c-ac969d47ed92): created successfully
Sep 07 18:14:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e829d2-f916-4f76-9068-757c1ed81a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Flow 'volume_create_manager' (1309ffb6-48a1-427c-943a-3163d6df0797) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:25 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0461ecf3-c5bb-4b41-ac89-d6aef02627ea tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Created volume successfully.
Sep 07 18:14:26 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-09027867-a38f-4d67-84fa-d85dbcd0a826 1073741824" returned: 0 in 0.397s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-09027867-a38f-4d67-84fa-d85dbcd0a826 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:26 devstack sudo[102850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-09027867-a38f-4d67-84fa-d85dbcd0a826
Sep 07 18:14:26 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:26 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-09027867-a38f-4d67-84fa-d85dbcd0a826" returned: 0 in 0.239s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:14:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.899s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-667087666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb1cee2-ccbd-4158-805b-083220bbea25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf52d5a40a294309a6b81b8bf08fb288',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:24Z,use_quota=True,user_id='08e488b9926a4b8b8a51172711390c2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:14:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Creating volume fdb1cee2-ccbd-4158-805b-083220bbea25 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:14:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:14:26 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:14:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fdb1cee2-ccbd-4158-805b-083220bbea25 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c04ece0-09e7-449a-b325-5aefc7508cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09027867-a38f-4d67-84fa-d85dbcd0a826', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:26 devstack sudo[102854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fdb1cee2-ccbd-4158-805b-083220bbea25 1073741824
Sep 07 18:14:26 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc281fd-a37e-46aa-a80a-be4fd04045d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:26 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Volume volume-09027867-a38f-4d67-84fa-d85dbcd0a826 (09027867-a38f-4d67-84fa-d85dbcd0a826): created successfully
Sep 07 18:14:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc281fd-a37e-46aa-a80a-be4fd04045d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Flow 'volume_create_manager' (09a9f1ef-e00d-41fc-9757-13f7339838e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:26 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-919ef73d-2051-476a-add3-937036167836 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Created volume successfully.
Sep 07 18:14:26 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fdb1cee2-ccbd-4158-805b-083220bbea25 1073741824" returned: 0 in 0.412s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fdb1cee2-ccbd-4158-805b-083220bbea25 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:26 devstack sudo[102859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fdb1cee2-ccbd-4158-805b-083220bbea25
Sep 07 18:14:26 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:26 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fdb1cee2-ccbd-4158-805b-083220bbea25" returned: 0 in 0.242s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:14:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-80751cb3-7d9c-4433-a545-de0791627ff4 tempest-VolumesDeleteCascade-1951048962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.291s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c0772f-30dc-475d-aea8-c71f15360fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdb1cee2-ccbd-4158-805b-083220bbea25', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a238eb-942b-403e-a032-0c11cb3e73fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-80751cb3-7d9c-4433-a545-de0791627ff4 tempest-VolumesDeleteCascade-1951048962 None] Creating offline snapshot 5a67848b-27c4-4acf-afc2-61221349e268 of volume 1fe401c0-0e8f-467f-a393-2cd5691ac630 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:14:27 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Volume volume-fdb1cee2-ccbd-4158-805b-083220bbea25 (fdb1cee2-ccbd-4158-805b-083220bbea25): created successfully
Sep 07 18:14:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5a238eb-942b-403e-a032-0c11cb3e73fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:27 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Flow 'volume_create_manager' (b635c979-2e47-4061-b9cd-cf60b2cc5e51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:27 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92f664f-bffe-44fb-bdbc-47d1881dfd50]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-80751cb3-7d9c-4433-a545-de0791627ff4 tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:27 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-71afbf42-872c-476d-8d04-0df27b96b864 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Created volume successfully.
Sep 07 18:14:27 devstack sudo[102862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630
Sep 07 18:14:27 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:27 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-80751cb3-7d9c-4433-a545-de0791627ff4 tempest-VolumesDeleteCascade-1951048962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630" returned: 0 in 0.341s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-80751cb3-7d9c-4433-a545-de0791627ff4 tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.5a67848b-27c4-4acf-afc2-61221349e268 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:27 devstack sudo[102867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.5a67848b-27c4-4acf-afc2-61221349e268 1G
Sep 07 18:14:27 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-93315ac9-f130-4c3e-8385-3963a6506795 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "cinder-fdb1cee2-ccbd-4158-805b-083220bbea25-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-93315ac9-f130-4c3e-8385-3963a6506795 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "cinder-fdb1cee2-ccbd-4158-805b-083220bbea25-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-93315ac9-f130-4c3e-8385-3963a6506795 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "cinder-quobyte-fdb1cee2-ccbd-4158-805b-083220bbea25" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-93315ac9-f130-4c3e-8385-3963a6506795 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "cinder-quobyte-fdb1cee2-ccbd-4158-805b-083220bbea25" acquired by "delete_volume" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:27 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a619c0ad-87e4-43c7-aeb0-9e7670208f2b]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-93315ac9-f130-4c3e-8385-3963a6506795 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fdb1cee2-ccbd-4158-805b-083220bbea25 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:27 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-80751cb3-7d9c-4433-a545-de0791627ff4 tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.5a67848b-27c4-4acf-afc2-61221349e268 1G" returned: 0 in 0.439s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-80751cb3-7d9c-4433-a545-de0791627ff4 tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fe401c0-0e8f-467f-a393-2cd5691ac630 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.5a67848b-27c4-4acf-afc2-61221349e268 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:27 devstack sudo[102874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fe401c0-0e8f-467f-a393-2cd5691ac630 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.5a67848b-27c4-4acf-afc2-61221349e268
Sep 07 18:14:27 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:27 devstack sudo[102873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fdb1cee2-ccbd-4158-805b-083220bbea25
Sep 07 18:14:27 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:28 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-80751cb3-7d9c-4433-a545-de0791627ff4 tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fe401c0-0e8f-467f-a393-2cd5691ac630 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.5a67848b-27c4-4acf-afc2-61221349e268" returned: 0 in 0.276s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:28 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-80751cb3-7d9c-4433-a545-de0791627ff4 tempest-VolumesDeleteCascade-1951048962 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.5a67848b-27c4-4acf-afc2-61221349e268 is being set with open permissions: ugo+rw
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-80751cb3-7d9c-4433-a545-de0791627ff4 tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.5a67848b-27c4-4acf-afc2-61221349e268 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:28 devstack sudo[102883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.5a67848b-27c4-4acf-afc2-61221349e268
Sep 07 18:14:28 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:28 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-93315ac9-f130-4c3e-8385-3963a6506795 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fdb1cee2-ccbd-4158-805b-083220bbea25" returned: 0 in 0.357s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-93315ac9-f130-4c3e-8385-3963a6506795 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fdb1cee2-ccbd-4158-805b-083220bbea25 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:28 devstack sudo[102887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fdb1cee2-ccbd-4158-805b-083220bbea25
Sep 07 18:14:28 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:28 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-80751cb3-7d9c-4433-a545-de0791627ff4 tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.5a67848b-27c4-4acf-afc2-61221349e268" returned: 0 in 0.236s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-80751cb3-7d9c-4433-a545-de0791627ff4 tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:28 devstack sudo[102891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.info
Sep 07 18:14:28 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:28 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-93315ac9-f130-4c3e-8385-3963a6506795 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fdb1cee2-ccbd-4158-805b-083220bbea25" returned: 0 in 0.263s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-93315ac9-f130-4c3e-8385-3963a6506795 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "cinder-quobyte-fdb1cee2-ccbd-4158-805b-083220bbea25" released by "delete_volume" :: held 0.668s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-93315ac9-f130-4c3e-8385-3963a6506795 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Created reservations ['e22615a5-2cf9-47b8-815a-c89adead95ea', 'feec2fbd-4222-412b-bcd7-241aead2ccc2', '00ce51ae-2878-4e5f-b43c-b2d72726c6b7', 'e2fbe390-088c-4cfb-9734-fa5989a051f3'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-93315ac9-f130-4c3e-8385-3963a6506795 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-93315ac9-f130-4c3e-8385-3963a6506795 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-93315ac9-f130-4c3e-8385-3963a6506795 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-93315ac9-f130-4c3e-8385-3963a6506795 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-93315ac9-f130-4c3e-8385-3963a6506795 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-93315ac9-f130-4c3e-8385-3963a6506795 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:28 devstack sudo[102893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:14:28 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:28 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-80751cb3-7d9c-4433-a545-de0791627ff4 tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.info" returned: 0 in 0.249s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:28 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-80751cb3-7d9c-4433-a545-de0791627ff4 tempest-VolumesDeleteCascade-1951048962 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.info is being set with open permissions: ugo+rw
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-80751cb3-7d9c-4433-a545-de0791627ff4 tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:28 devstack sudo[102896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.info
Sep 07 18:14:28 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:28 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-93315ac9-f130-4c3e-8385-3963a6506795 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.261s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-93315ac9-f130-4c3e-8385-3963a6506795 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:14:28 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-93315ac9-f130-4c3e-8385-3963a6506795 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Deleted volume successfully.
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-93315ac9-f130-4c3e-8385-3963a6506795 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "cinder-fdb1cee2-ccbd-4158-805b-083220bbea25-delete_volume" released by "delete_volume" :: held 1.130s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-16613730-d4a0-4e24-9b14-fa75e9eb37b9 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "cinder-09027867-a38f-4d67-84fa-d85dbcd0a826-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:28 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-80751cb3-7d9c-4433-a545-de0791627ff4 tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.info" returned: 0 in 0.262s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-80751cb3-7d9c-4433-a545-de0791627ff4 tempest-VolumesDeleteCascade-1951048962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.912s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-16613730-d4a0-4e24-9b14-fa75e9eb37b9 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "cinder-09027867-a38f-4d67-84fa-d85dbcd0a826-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:28 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-80751cb3-7d9c-4433-a545-de0791627ff4 tempest-VolumesDeleteCascade-1951048962 None] Create snapshot completed successfully
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-16613730-d4a0-4e24-9b14-fa75e9eb37b9 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "cinder-quobyte-09027867-a38f-4d67-84fa-d85dbcd0a826" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-16613730-d4a0-4e24-9b14-fa75e9eb37b9 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "cinder-quobyte-09027867-a38f-4d67-84fa-d85dbcd0a826" acquired by "delete_volume" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f248b0-ecda-4b76-966b-93722db495da]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16613730-d4a0-4e24-9b14-fa75e9eb37b9 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-09027867-a38f-4d67-84fa-d85dbcd0a826 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:29 devstack sudo[102900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-09027867-a38f-4d67-84fa-d85dbcd0a826
Sep 07 18:14:29 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:29 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16613730-d4a0-4e24-9b14-fa75e9eb37b9 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-09027867-a38f-4d67-84fa-d85dbcd0a826" returned: 0 in 0.334s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16613730-d4a0-4e24-9b14-fa75e9eb37b9 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-09027867-a38f-4d67-84fa-d85dbcd0a826 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:29 devstack sudo[102905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-09027867-a38f-4d67-84fa-d85dbcd0a826
Sep 07 18:14:29 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:29 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16613730-d4a0-4e24-9b14-fa75e9eb37b9 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-09027867-a38f-4d67-84fa-d85dbcd0a826" returned: 0 in 0.250s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-16613730-d4a0-4e24-9b14-fa75e9eb37b9 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "cinder-quobyte-09027867-a38f-4d67-84fa-d85dbcd0a826" released by "delete_volume" :: held 0.619s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:29 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-16613730-d4a0-4e24-9b14-fa75e9eb37b9 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Created reservations ['fd304af5-3418-44d8-b0e5-9cee3c13a985', '9a9f6ead-f840-41f5-bc84-2c524e216820', 'bc31cbd8-c326-4361-8e07-5963e062e1bf', '968a69d0-da56-4057-8afa-c4844f17a8a4'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:14:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-16613730-d4a0-4e24-9b14-fa75e9eb37b9 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-16613730-d4a0-4e24-9b14-fa75e9eb37b9 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-16613730-d4a0-4e24-9b14-fa75e9eb37b9 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-16613730-d4a0-4e24-9b14-fa75e9eb37b9 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-16613730-d4a0-4e24-9b14-fa75e9eb37b9 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16613730-d4a0-4e24-9b14-fa75e9eb37b9 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:29 devstack sudo[102908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:14:29 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:29 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16613730-d4a0-4e24-9b14-fa75e9eb37b9 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.250s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:29 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-16613730-d4a0-4e24-9b14-fa75e9eb37b9 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:14:29 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-16613730-d4a0-4e24-9b14-fa75e9eb37b9 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Deleted volume successfully.
Sep 07 18:14:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-16613730-d4a0-4e24-9b14-fa75e9eb37b9 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "cinder-09027867-a38f-4d67-84fa-d85dbcd0a826-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c5c8b872-e591-47f2-be96-4068faecd93b tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "cinder-f062c610-5ddb-4800-8f6c-ac969d47ed92-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c5c8b872-e591-47f2-be96-4068faecd93b tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "cinder-f062c610-5ddb-4800-8f6c-ac969d47ed92-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c5c8b872-e591-47f2-be96-4068faecd93b tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "cinder-quobyte-f062c610-5ddb-4800-8f6c-ac969d47ed92" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c5c8b872-e591-47f2-be96-4068faecd93b tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "cinder-quobyte-f062c610-5ddb-4800-8f6c-ac969d47ed92" acquired by "delete_volume" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e06902-bd23-4219-88aa-3846e677cde7]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c5c8b872-e591-47f2-be96-4068faecd93b tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f062c610-5ddb-4800-8f6c-ac969d47ed92 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:30 devstack sudo[102911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f062c610-5ddb-4800-8f6c-ac969d47ed92
Sep 07 18:14:30 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Flow 'volume_create_manager' (e2edc693-6fb2-4d8e-81da-5594a6cf283a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53389311-7723-468b-b85e-7d483d15609b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:30 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c5c8b872-e591-47f2-be96-4068faecd93b tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f062c610-5ddb-4800-8f6c-ac969d47ed92" returned: 0 in 0.372s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c5c8b872-e591-47f2-be96-4068faecd93b tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f062c610-5ddb-4800-8f6c-ac969d47ed92 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53389311-7723-468b-b85e-7d483d15609b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-111637537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88d34c1d-5b1d-40c3-9057-b7cfc4d46b71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff7c904dc4524264a0069accd648b603',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5a67848b-27c4-4acf-afc2-61221349e268,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:30Z,use_quota=True,user_id='d4fcd2bfdd224b9a9afddf686373a00d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:30 devstack sudo[102916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f062c610-5ddb-4800-8f6c-ac969d47ed92
Sep 07 18:14:30 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6e630e-f77c-4d8b-b11c-605d53e9f33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da6e630e-f77c-4d8b-b11c-605d53e9f33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc42df8-5c7e-45c8-bf84-c15951d80611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc42df8-5c7e-45c8-bf84-c15951d80611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '88d34c1d-5b1d-40c3-9057-b7cfc4d46b71', 'volume_name': 'volume-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71', 'volume_size': 1, 'snapshot_id': '5a67848b-27c4-4acf-afc2-61221349e268'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83365d45-b612-42fc-b929-87b1715c457e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83365d45-b612-42fc-b929-87b1715c457e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c653a97-a482-4008-9f3d-3a385ac3b69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:30 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Volume 88d34c1d-5b1d-40c3-9057-b7cfc4d46b71: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71', 'volume_size': 1, 'snapshot_id': '5a67848b-27c4-4acf-afc2-61221349e268'}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "cinder-quobyte-5a67848b-27c4-4acf-afc2-61221349e268-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71" by "_create_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-quobyte-5a67848b-27c4-4acf-afc2-61221349e268-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Creating volume 88d34c1d-5b1d-40c3-9057-b7cfc4d46b71 from snapshot 5a67848b-27c4-4acf-afc2-61221349e268 {{(pid=87269) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "cinder-quobyte-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71" by "_copy_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-quobyte-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] snapshot: 5a67848b-27c4-4acf-afc2-61221349e268, volume: 88d34c1d-5b1d-40c3-9057-b7cfc4d46b71,  {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5829671a-09f4-4e53-8be7-c9b4321f7c71]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.5a67848b-27c4-4acf-afc2-61221349e268 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:30 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c5c8b872-e591-47f2-be96-4068faecd93b tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f062c610-5ddb-4800-8f6c-ac969d47ed92" returned: 0 in 0.260s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:30 devstack sudo[102918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.5a67848b-27c4-4acf-afc2-61221349e268
Sep 07 18:14:30 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c5c8b872-e591-47f2-be96-4068faecd93b tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "cinder-quobyte-f062c610-5ddb-4800-8f6c-ac969d47ed92" released by "delete_volume" :: held 0.687s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-c5c8b872-e591-47f2-be96-4068faecd93b tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Created reservations ['1cc2cc73-0e71-436e-a1fe-f9a061160bf1', '5822792a-2d2f-4efb-b47a-fc5733e21df4', 'e15d4111-5f1f-4d98-bfd6-89bd9af678f5', '9008e098-da0d-46ae-b2cd-8a04e83141ea'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c5c8b872-e591-47f2-be96-4068faecd93b tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c5c8b872-e591-47f2-be96-4068faecd93b tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c5c8b872-e591-47f2-be96-4068faecd93b tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c5c8b872-e591-47f2-be96-4068faecd93b tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c5c8b872-e591-47f2-be96-4068faecd93b tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c5c8b872-e591-47f2-be96-4068faecd93b tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:31 devstack sudo[102922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:14:31 devstack sudo[102922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:31 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.5a67848b-27c4-4acf-afc2-61221349e268" returned: 0 in 0.378s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fe401c0-0e8f-467f-a393-2cd5691ac630(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:14:31 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e2e63f-7352-44b4-a3c4-f90c1549588f]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:31 devstack sudo[102926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630
Sep 07 18:14:31 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d9b5ce7b-9599-4f9e-af82-6247444062e8 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "cinder-b44a837e-7081-48b2-a130-c64634ebf855-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d9b5ce7b-9599-4f9e-af82-6247444062e8 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "cinder-b44a837e-7081-48b2-a130-c64634ebf855-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:31 devstack sudo[102922]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c5c8b872-e591-47f2-be96-4068faecd93b tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.281s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:31 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-c5c8b872-e591-47f2-be96-4068faecd93b tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:14:31 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-c5c8b872-e591-47f2-be96-4068faecd93b tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Deleted volume successfully.
Sep 07 18:14:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d9b5ce7b-9599-4f9e-af82-6247444062e8 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "cinder-quobyte-b44a837e-7081-48b2-a130-c64634ebf855" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c5c8b872-e591-47f2-be96-4068faecd93b tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "cinder-f062c610-5ddb-4800-8f6c-ac969d47ed92-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:31 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d9b5ce7b-9599-4f9e-af82-6247444062e8 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "cinder-quobyte-b44a837e-7081-48b2-a130-c64634ebf855" acquired by "delete_volume" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:31 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18b399d-5d29-4406-935c-c711f34e6c14]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d9b5ce7b-9599-4f9e-af82-6247444062e8 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b44a837e-7081-48b2-a130-c64634ebf855 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:31 devstack sudo[102929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b44a837e-7081-48b2-a130-c64634ebf855
Sep 07 18:14:31 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:31 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630" returned: 0 in 0.402s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] will copy from snapshot at /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630 {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 07 18:14:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Creating direct copy from snapshot {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 07 18:14:31 devstack cinder-volume[87269]: DEBUG cinder.utils [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Path /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71 not found in is_blk_device check {{(pid=87269) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 07 18:14:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:31 devstack sudo[102934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71
Sep 07 18:14:31 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:31 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:31 devstack sudo[102944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b44a837e-7081-48b2-a130-c64634ebf855
Sep 07 18:14:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d9b5ce7b-9599-4f9e-af82-6247444062e8 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b44a837e-7081-48b2-a130-c64634ebf855" returned: 0 in 0.368s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d9b5ce7b-9599-4f9e-af82-6247444062e8 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b44a837e-7081-48b2-a130-c64634ebf855 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:31 devstack sudo[102944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:32 devstack sudo[102944]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d9b5ce7b-9599-4f9e-af82-6247444062e8 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b44a837e-7081-48b2-a130-c64634ebf855" returned: 0 in 0.403s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d9b5ce7b-9599-4f9e-af82-6247444062e8 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "cinder-quobyte-b44a837e-7081-48b2-a130-c64634ebf855" released by "delete_volume" :: held 0.819s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:32 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-d9b5ce7b-9599-4f9e-af82-6247444062e8 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Created reservations ['6379b0fc-a1a6-42ba-ac69-aebf1f1f2aad', '68be55c2-1c26-4ce4-b641-fd64dd5ee17f', 'c2ecaf16-fad2-4c81-83d8-d4d0b2b42b9e', 'd3f7d7ab-6fa7-4faf-ab12-1b3f3a938eb6'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:14:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d9b5ce7b-9599-4f9e-af82-6247444062e8 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d9b5ce7b-9599-4f9e-af82-6247444062e8 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d9b5ce7b-9599-4f9e-af82-6247444062e8 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:32 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d9b5ce7b-9599-4f9e-af82-6247444062e8 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d9b5ce7b-9599-4f9e-af82-6247444062e8 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d9b5ce7b-9599-4f9e-af82-6247444062e8 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:32 devstack sudo[102955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:14:32 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1f7c4dfb-1086-4104-9dac-d7e89f4de422 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "cinder-f79b0677-2a01-4d61-947f-ef787a4a6197-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1f7c4dfb-1086-4104-9dac-d7e89f4de422 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "cinder-f79b0677-2a01-4d61-947f-ef787a4a6197-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1f7c4dfb-1086-4104-9dac-d7e89f4de422 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "cinder-quobyte-f79b0677-2a01-4d61-947f-ef787a4a6197" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1f7c4dfb-1086-4104-9dac-d7e89f4de422 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "cinder-quobyte-f79b0677-2a01-4d61-947f-ef787a4a6197" acquired by "delete_volume" :: waited 0.056s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:32 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0ad0d1-db10-4ef8-8935-298c3ef0abec]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1f7c4dfb-1086-4104-9dac-d7e89f4de422 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f79b0677-2a01-4d61-947f-ef787a4a6197 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:33 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d9b5ce7b-9599-4f9e-af82-6247444062e8 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.667s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:33 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-d9b5ce7b-9599-4f9e-af82-6247444062e8 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:14:33 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d9b5ce7b-9599-4f9e-af82-6247444062e8 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Deleted volume successfully.
Sep 07 18:14:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d9b5ce7b-9599-4f9e-af82-6247444062e8 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "cinder-b44a837e-7081-48b2-a130-c64634ebf855-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:33 devstack sudo[102958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f79b0677-2a01-4d61-947f-ef787a4a6197
Sep 07 18:14:33 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:33 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1f7c4dfb-1086-4104-9dac-d7e89f4de422 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f79b0677-2a01-4d61-947f-ef787a4a6197" returned: 0 in 0.658s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1f7c4dfb-1086-4104-9dac-d7e89f4de422 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f79b0677-2a01-4d61-947f-ef787a4a6197 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:33 devstack sudo[102963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f79b0677-2a01-4d61-947f-ef787a4a6197
Sep 07 18:14:33 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:34 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1f7c4dfb-1086-4104-9dac-d7e89f4de422 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f79b0677-2a01-4d61-947f-ef787a4a6197" returned: 0 in 0.814s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1f7c4dfb-1086-4104-9dac-d7e89f4de422 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "cinder-quobyte-f79b0677-2a01-4d61-947f-ef787a4a6197" released by "delete_volume" :: held 1.566s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:34 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-1f7c4dfb-1086-4104-9dac-d7e89f4de422 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Created reservations ['eb88887d-4aee-49e2-9f78-11dc4d8e4b47', 'e9ad274c-532b-489c-9607-c0e09235ac24', '4b387eac-4ff5-4da6-8f54-cfc20820f626', '8b01abbb-2ded-442d-a2fb-80a25967a935'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:14:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1f7c4dfb-1086-4104-9dac-d7e89f4de422 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1f7c4dfb-1086-4104-9dac-d7e89f4de422 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1f7c4dfb-1086-4104-9dac-d7e89f4de422 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1f7c4dfb-1086-4104-9dac-d7e89f4de422 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1f7c4dfb-1086-4104-9dac-d7e89f4de422 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1f7c4dfb-1086-4104-9dac-d7e89f4de422 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:34 devstack sudo[102966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:14:34 devstack sudo[102966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:35 devstack sudo[102966]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1f7c4dfb-1086-4104-9dac-d7e89f4de422 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.427s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:35 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-1f7c4dfb-1086-4104-9dac-d7e89f4de422 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:14:35 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-1f7c4dfb-1086-4104-9dac-d7e89f4de422 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Deleted volume successfully.
Sep 07 18:14:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1f7c4dfb-1086-4104-9dac-d7e89f4de422 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "cinder-f79b0677-2a01-4d61-947f-ef787a4a6197-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-58a0d850-0e35-48e1-a5ca-94734a634e03 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "cinder-eecf2238-bc25-42af-8c69-1353295b8500-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-58a0d850-0e35-48e1-a5ca-94734a634e03 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "cinder-eecf2238-bc25-42af-8c69-1353295b8500-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-58a0d850-0e35-48e1-a5ca-94734a634e03 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "cinder-quobyte-eecf2238-bc25-42af-8c69-1353295b8500" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-58a0d850-0e35-48e1-a5ca-94734a634e03 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "cinder-quobyte-eecf2238-bc25-42af-8c69-1353295b8500" acquired by "delete_volume" :: waited 0.043s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:35 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd77f46-2a6b-4c37-8f0e-fc5230514485]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58a0d850-0e35-48e1-a5ca-94734a634e03 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-eecf2238-bc25-42af-8c69-1353295b8500 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:35 devstack sudo[102971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-eecf2238-bc25-42af-8c69-1353295b8500
Sep 07 18:14:35 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:36 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58a0d850-0e35-48e1-a5ca-94734a634e03 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-eecf2238-bc25-42af-8c69-1353295b8500" returned: 0 in 0.677s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58a0d850-0e35-48e1-a5ca-94734a634e03 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-eecf2238-bc25-42af-8c69-1353295b8500 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:36 devstack sudo[102977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-eecf2238-bc25-42af-8c69-1353295b8500
Sep 07 18:14:36 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:36 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71" returned: 0 in 4.805s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:36 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Image conversion details: src /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630, size 1024.00 MB, duration 4.81 sec, destination /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 07 18:14:36 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Converted 1024.00 MB image at 213.03 MB/s
Sep 07 18:14:36 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71 is being set with open permissions: ugo+rw
Sep 07 18:14:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:36 devstack sudo[102979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71
Sep 07 18:14:36 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:36 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58a0d850-0e35-48e1-a5ca-94734a634e03 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-eecf2238-bc25-42af-8c69-1353295b8500" returned: 0 in 0.251s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-58a0d850-0e35-48e1-a5ca-94734a634e03 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "cinder-quobyte-eecf2238-bc25-42af-8c69-1353295b8500" released by "delete_volume" :: held 1.015s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:36 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71" returned: 0 in 0.239s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-quobyte-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71" released by "_copy_volume_from_snapshot" :: held 5.906s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-quobyte-5a67848b-27c4-4acf-afc2-61221349e268-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71" released by "_create_volume_from_snapshot" :: held 5.982s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:36 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-58a0d850-0e35-48e1-a5ca-94734a634e03 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Created reservations ['119d0bcc-03ef-4096-9935-ef053f5870d2', '109e85c0-0019-42cb-86d6-f67492a8f55b', 'bf89ff1a-a214-4b3c-ac25-d8810689620e', '9be86589-b7f0-4e09-89af-a408011a8ecc'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:14:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c653a97-a482-4008-9f3d-3a385ac3b69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71', 'volume_size': 1, 'snapshot_id': '5a67848b-27c4-4acf-afc2-61221349e268'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (053f8983-53f1-4c93-bcc3-20b43ced2e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:36 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Volume volume-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71 (88d34c1d-5b1d-40c3-9057-b7cfc4d46b71): created successfully
Sep 07 18:14:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (053f8983-53f1-4c93-bcc3-20b43ced2e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:36 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Flow 'volume_create_manager' (e2edc693-6fb2-4d8e-81da-5594a6cf283a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:36 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-289a54db-1e94-4764-9b1b-225ac5ab7346 tempest-VolumesDeleteCascade-1951048962 None] Created volume successfully.
Sep 07 18:14:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-58a0d850-0e35-48e1-a5ca-94734a634e03 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-58a0d850-0e35-48e1-a5ca-94734a634e03 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-58a0d850-0e35-48e1-a5ca-94734a634e03 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-58a0d850-0e35-48e1-a5ca-94734a634e03 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-58a0d850-0e35-48e1-a5ca-94734a634e03 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58a0d850-0e35-48e1-a5ca-94734a634e03 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:36 devstack sudo[102983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:14:36 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:36 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58a0d850-0e35-48e1-a5ca-94734a634e03 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.237s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:36 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-58a0d850-0e35-48e1-a5ca-94734a634e03 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:14:36 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-58a0d850-0e35-48e1-a5ca-94734a634e03 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Deleted volume successfully.
Sep 07 18:14:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-58a0d850-0e35-48e1-a5ca-94734a634e03 tempest-CreateVolumesFromSourceVolumeTest-1151341178 None] Lock "cinder-eecf2238-bc25-42af-8c69-1353295b8500-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "cinder-1fe401c0-0e8f-467f-a393-2cd5691ac630-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-1fe401c0-0e8f-467f-a393-2cd5691ac630-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:37 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Performing cascade delete. {{(pid=87269) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 07 18:14:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "cinder-5a67848b-27c4-4acf-afc2-61221349e268-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-5a67848b-27c4-4acf-afc2-61221349e268-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "cinder-quobyte-1fe401c0-0e8f-467f-a393-2cd5691ac630" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-quobyte-1fe401c0-0e8f-467f-a393-2cd5691ac630" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "cinder-quobyte-5a67848b-27c4-4acf-afc2-61221349e268" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-quobyte-5a67848b-27c4-4acf-afc2-61221349e268" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Deleting offline snapshot 5a67848b-27c4-4acf-afc2-61221349e268 of volume 1fe401c0-0e8f-467f-a393-2cd5691ac630 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:14:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] snapshot_file for this snap is: volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.5a67848b-27c4-4acf-afc2-61221349e268 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:14:37 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0582fee0-2b8e-49fd-8b97-36c79727f887]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.5a67848b-27c4-4acf-afc2-61221349e268 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:37 devstack sudo[102986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.5a67848b-27c4-4acf-afc2-61221349e268
Sep 07 18:14:37 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:37 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.5a67848b-27c4-4acf-afc2-61221349e268" returned: 0 in 0.371s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fe401c0-0e8f-467f-a393-2cd5691ac630(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:14:37 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[df678372-1921-440f-95e6-0c640eed57fd]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:37 devstack sudo[102992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630
Sep 07 18:14:37 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:38 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630" returned: 0 in 0.587s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.5a67848b-27c4-4acf-afc2-61221349e268 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:38 devstack sudo[102999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.5a67848b-27c4-4acf-afc2-61221349e268
Sep 07 18:14:38 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:38 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.5a67848b-27c4-4acf-afc2-61221349e268" returned: 0 in 0.350s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.5a67848b-27c4-4acf-afc2-61221349e268 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:38 devstack sudo[103005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.5a67848b-27c4-4acf-afc2-61221349e268
Sep 07 18:14:38 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:38 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630.5a67848b-27c4-4acf-afc2-61221349e268" returned: 0 in 0.264s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-quobyte-5a67848b-27c4-4acf-afc2-61221349e268" released by "_delete_snapshot" :: held 1.668s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-quobyte-1fe401c0-0e8f-467f-a393-2cd5691ac630" released by "delete_snapshot" :: held 1.688s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:39 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Created reservations ['2d07ff45-5213-4e05-ac47-d17ac71a019f', 'af2e6c8c-5d37-44db-a072-33b7fb8d18e6', '212c99df-ad7b-4424-8b61-4ad938a75b98', 'a4df9520-08ed-4851-a87c-13e7f0667155'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:14:39 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Delete snapshot completed successfully.
Sep 07 18:14:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-5a67848b-27c4-4acf-afc2-61221349e268-delete_snapshot" released by "delete_snapshot" :: held 1.827s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Snapshots deleted, issuing volume delete {{(pid=87269) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 07 18:14:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "cinder-quobyte-1fe401c0-0e8f-467f-a393-2cd5691ac630" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-quobyte-1fe401c0-0e8f-467f-a393-2cd5691ac630" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:39 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0f4b13-e01b-4b09-b482-879a80d671fc]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:39 devstack sudo[103008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630
Sep 07 18:14:39 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:39 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630" returned: 0 in 0.342s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:39 devstack sudo[103013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630
Sep 07 18:14:39 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:39 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fe401c0-0e8f-467f-a393-2cd5691ac630" returned: 0 in 0.242s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-quobyte-1fe401c0-0e8f-467f-a393-2cd5691ac630" released by "delete_volume" :: held 0.645s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:39 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Created reservations ['73a1a506-2ded-4213-a56f-5aed9e78b806', 'f5cf0ba7-4821-492c-89f3-ceb0dcd6eebe', '5ba3f041-d006-421d-9e0c-38d9caa8cfb2', 'c94036a9-7939-4468-b86b-16f36f9478db'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:14:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:39 devstack sudo[103016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:14:39 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:40 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.234s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:40 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:14:40 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Deleted volume successfully.
Sep 07 18:14:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-816ca0bb-1248-4552-a7a3-9f7c1e14b307 tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-1fe401c0-0e8f-467f-a393-2cd5691ac630-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-638f94d8-5e0d-4391-9f3f-868b0383d755 tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "cinder-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-638f94d8-5e0d-4391-9f3f-868b0383d755 tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-638f94d8-5e0d-4391-9f3f-868b0383d755 tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "cinder-quobyte-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-638f94d8-5e0d-4391-9f3f-868b0383d755 tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-quobyte-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71" acquired by "delete_volume" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:40 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5501c245-48be-4938-8651-ab0f61e745d3]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-638f94d8-5e0d-4391-9f3f-868b0383d755 tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:40 devstack sudo[103019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71
Sep 07 18:14:40 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:41 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-638f94d8-5e0d-4391-9f3f-868b0383d755 tempest-VolumesDeleteCascade-1951048962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71" returned: 0 in 0.348s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-638f94d8-5e0d-4391-9f3f-868b0383d755 tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:41 devstack sudo[103024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71
Sep 07 18:14:41 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:41 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-638f94d8-5e0d-4391-9f3f-868b0383d755 tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71" returned: 0 in 0.235s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:41 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-638f94d8-5e0d-4391-9f3f-868b0383d755 tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-quobyte-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71" released by "delete_volume" :: held 0.619s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:41 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-638f94d8-5e0d-4391-9f3f-868b0383d755 tempest-VolumesDeleteCascade-1951048962 None] Created reservations ['fbdcea99-13ff-448c-8c95-3332b2de7652', '2dc95ec5-b4ea-4787-974d-e754e3d0024e', '5d75d986-bac0-4b50-8cb8-9aef0080f1d7', '07461c4f-f3ab-4ce2-a0de-ccc89ad3e970'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:14:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-638f94d8-5e0d-4391-9f3f-868b0383d755 tempest-VolumesDeleteCascade-1951048962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-638f94d8-5e0d-4391-9f3f-868b0383d755 tempest-VolumesDeleteCascade-1951048962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-638f94d8-5e0d-4391-9f3f-868b0383d755 tempest-VolumesDeleteCascade-1951048962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-638f94d8-5e0d-4391-9f3f-868b0383d755 tempest-VolumesDeleteCascade-1951048962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-638f94d8-5e0d-4391-9f3f-868b0383d755 tempest-VolumesDeleteCascade-1951048962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-638f94d8-5e0d-4391-9f3f-868b0383d755 tempest-VolumesDeleteCascade-1951048962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:41 devstack sudo[103027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:14:41 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:41 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-638f94d8-5e0d-4391-9f3f-868b0383d755 tempest-VolumesDeleteCascade-1951048962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.240s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:41 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-638f94d8-5e0d-4391-9f3f-868b0383d755 tempest-VolumesDeleteCascade-1951048962 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:14:41 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-638f94d8-5e0d-4391-9f3f-868b0383d755 tempest-VolumesDeleteCascade-1951048962 None] Deleted volume successfully.
Sep 07 18:14:41 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-638f94d8-5e0d-4391-9f3f-868b0383d755 tempest-VolumesDeleteCascade-1951048962 None] Lock "cinder-88d34c1d-5b1d-40c3-9057-b7cfc4d46b71-delete_volume" released by "delete_volume" :: held 1.040s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Flow 'volume_create_manager' (df68cb3d-e958-4582-a6f4-74b5835a8f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b7c050-fa25-41db-8f68-2ec326bb4a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75b7c050-fa25-41db-8f68-2ec326bb4a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1865749639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a6e484-2b4c-452c-aa1c-b1001dca84ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='669b87fe75bb47fdaf2136653bfcbecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:45Z,use_quota=True,user_id='3db93837683b4667a0f9e01e4eab4b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422bca54-7b50-4d6d-884b-f606821db5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422bca54-7b50-4d6d-884b-f606821db5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f63846a-92c7-45b7-9572-976f68c1864b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f63846a-92c7-45b7-9572-976f68c1864b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25a6e484-2b4c-452c-aa1c-b1001dca84ae', 'volume_name': 'volume-25a6e484-2b4c-452c-aa1c-b1001dca84ae', 'volume_size': 2}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1fca165-ab82-405f-9c91-a5eb46df0868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1fca165-ab82-405f-9c91-a5eb46df0868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (382ce768-a83c-459c-abb6-f1fb60798720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:45 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Volume 25a6e484-2b4c-452c-aa1c-b1001dca84ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25a6e484-2b4c-452c-aa1c-b1001dca84ae', 'volume_size': 2}
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1865749639',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25a6e484-2b4c-452c-aa1c-b1001dca84ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='669b87fe75bb47fdaf2136653bfcbecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:45Z,use_quota=True,user_id='3db93837683b4667a0f9e01e4eab4b93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Creating volume 25a6e484-2b4c-452c-aa1c-b1001dca84ae {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:14:45 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-25a6e484-2b4c-452c-aa1c-b1001dca84ae 2147483648 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:45 devstack sudo[103030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-25a6e484-2b4c-452c-aa1c-b1001dca84ae 2147483648
Sep 07 18:14:45 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:45 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-25a6e484-2b4c-452c-aa1c-b1001dca84ae 2147483648" returned: 0 in 0.450s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-25a6e484-2b4c-452c-aa1c-b1001dca84ae {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:45 devstack sudo[103036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-25a6e484-2b4c-452c-aa1c-b1001dca84ae
Sep 07 18:14:45 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:45 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-25a6e484-2b4c-452c-aa1c-b1001dca84ae" returned: 0 in 0.238s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (382ce768-a83c-459c-abb6-f1fb60798720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25a6e484-2b4c-452c-aa1c-b1001dca84ae', 'volume_size': 2}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (181330d1-40c9-410a-a644-af1b5ec996d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:45 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Volume volume-25a6e484-2b4c-452c-aa1c-b1001dca84ae (25a6e484-2b4c-452c-aa1c-b1001dca84ae): created successfully
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (181330d1-40c9-410a-a644-af1b5ec996d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Flow 'volume_create_manager' (df68cb3d-e958-4582-a6f4-74b5835a8f17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:45 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e4f2e8ae-643c-42b1-b650-229fa99f03dc tempest-VolumesCloneNegativeTest-1412812645 None] Created volume successfully.
Sep 07 18:14:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-94438647-6755-4bec-a2fb-94854814d7b3 tempest-VolumesCloneNegativeTest-1412812645 None] Acquiring lock "cinder-25a6e484-2b4c-452c-aa1c-b1001dca84ae-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-94438647-6755-4bec-a2fb-94854814d7b3 tempest-VolumesCloneNegativeTest-1412812645 None] Lock "cinder-25a6e484-2b4c-452c-aa1c-b1001dca84ae-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-94438647-6755-4bec-a2fb-94854814d7b3 tempest-VolumesCloneNegativeTest-1412812645 None] Acquiring lock "cinder-quobyte-25a6e484-2b4c-452c-aa1c-b1001dca84ae" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-94438647-6755-4bec-a2fb-94854814d7b3 tempest-VolumesCloneNegativeTest-1412812645 None] Lock "cinder-quobyte-25a6e484-2b4c-452c-aa1c-b1001dca84ae" acquired by "delete_volume" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:46 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cc3a10-cc38-4811-abea-258d4982d280]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-94438647-6755-4bec-a2fb-94854814d7b3 tempest-VolumesCloneNegativeTest-1412812645 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-25a6e484-2b4c-452c-aa1c-b1001dca84ae {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:46 devstack sudo[103040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-25a6e484-2b4c-452c-aa1c-b1001dca84ae
Sep 07 18:14:46 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:46 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-94438647-6755-4bec-a2fb-94854814d7b3 tempest-VolumesCloneNegativeTest-1412812645 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-25a6e484-2b4c-452c-aa1c-b1001dca84ae" returned: 0 in 0.348s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-94438647-6755-4bec-a2fb-94854814d7b3 tempest-VolumesCloneNegativeTest-1412812645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-25a6e484-2b4c-452c-aa1c-b1001dca84ae {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:46 devstack sudo[103045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-25a6e484-2b4c-452c-aa1c-b1001dca84ae
Sep 07 18:14:46 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:46 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-94438647-6755-4bec-a2fb-94854814d7b3 tempest-VolumesCloneNegativeTest-1412812645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-25a6e484-2b4c-452c-aa1c-b1001dca84ae" returned: 0 in 0.238s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:46 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-94438647-6755-4bec-a2fb-94854814d7b3 tempest-VolumesCloneNegativeTest-1412812645 None] Lock "cinder-quobyte-25a6e484-2b4c-452c-aa1c-b1001dca84ae" released by "delete_volume" :: held 0.620s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:46 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-94438647-6755-4bec-a2fb-94854814d7b3 tempest-VolumesCloneNegativeTest-1412812645 None] Created reservations ['e9be4558-3185-49ad-be84-c3677a8924fb', '0539c3f9-1519-4e9d-b9e0-dc0c9cc64d28', '9815005e-7fce-437a-9510-90b0524f0fd4', 'f8cc7b33-ff2c-4a43-8027-f1241dd64681'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:14:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-94438647-6755-4bec-a2fb-94854814d7b3 tempest-VolumesCloneNegativeTest-1412812645 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-94438647-6755-4bec-a2fb-94854814d7b3 tempest-VolumesCloneNegativeTest-1412812645 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-94438647-6755-4bec-a2fb-94854814d7b3 tempest-VolumesCloneNegativeTest-1412812645 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-94438647-6755-4bec-a2fb-94854814d7b3 tempest-VolumesCloneNegativeTest-1412812645 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-94438647-6755-4bec-a2fb-94854814d7b3 tempest-VolumesCloneNegativeTest-1412812645 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-94438647-6755-4bec-a2fb-94854814d7b3 tempest-VolumesCloneNegativeTest-1412812645 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:47 devstack sudo[103048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:14:47 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:47 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-94438647-6755-4bec-a2fb-94854814d7b3 tempest-VolumesCloneNegativeTest-1412812645 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.245s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:47 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-94438647-6755-4bec-a2fb-94854814d7b3 tempest-VolumesCloneNegativeTest-1412812645 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:14:47 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-94438647-6755-4bec-a2fb-94854814d7b3 tempest-VolumesCloneNegativeTest-1412812645 None] Deleted volume successfully.
Sep 07 18:14:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-94438647-6755-4bec-a2fb-94854814d7b3 tempest-VolumesCloneNegativeTest-1412812645 None] Lock "cinder-25a6e484-2b4c-452c-aa1c-b1001dca84ae-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:50 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:14:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Flow 'volume_create_manager' (dc67cc66-095f-47c0-ac84-82aec1ec979e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c89805e8-1e69-4464-9fbf-d14f208a0dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c89805e8-1e69-4464-9fbf-d14f208a0dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-88946421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e5e55da-57df-4a0e-bcf1-424f899d93f0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='84dca37f99b6486f851b723b43204eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:51Z,use_quota=True,user_id='9cf71f6feb154a4bbddeb955c187e666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44956bd3-d9a7-433d-875f-3026dc0bb8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44956bd3-d9a7-433d-875f-3026dc0bb8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466b0729-028a-4115-9e1d-f3bfa509ceaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466b0729-028a-4115-9e1d-f3bfa509ceaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e5e55da-57df-4a0e-bcf1-424f899d93f0', 'volume_name': 'volume-6e5e55da-57df-4a0e-bcf1-424f899d93f0', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71fd0497-d94a-4d63-b5c5-903184d4155d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71fd0497-d94a-4d63-b5c5-903184d4155d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb663af1-f1ff-42fe-ace0-2146780c1f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:50 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Volume 6e5e55da-57df-4a0e-bcf1-424f899d93f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e5e55da-57df-4a0e-bcf1-424f899d93f0', 'volume_size': 1}
Sep 07 18:14:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-88946421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e5e55da-57df-4a0e-bcf1-424f899d93f0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='84dca37f99b6486f851b723b43204eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:51Z,use_quota=True,user_id='9cf71f6feb154a4bbddeb955c187e666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:14:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Creating volume 6e5e55da-57df-4a0e-bcf1-424f899d93f0 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:14:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:14:50 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:14:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6e5e55da-57df-4a0e-bcf1-424f899d93f0 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:50 devstack sudo[103051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6e5e55da-57df-4a0e-bcf1-424f899d93f0 1073741824
Sep 07 18:14:50 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:51 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6e5e55da-57df-4a0e-bcf1-424f899d93f0 1073741824" returned: 0 in 0.419s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:51 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=228,cinder:SELECT=181,cinder:DELETE=21,cinder:INSERT=55 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:14:51 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=167,cinder:INSERT=62,cinder:UPDATE=248,cinder:DELETE=20 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:14:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6e5e55da-57df-4a0e-bcf1-424f899d93f0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:51 devstack sudo[103057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6e5e55da-57df-4a0e-bcf1-424f899d93f0
Sep 07 18:14:51 devstack sudo[103057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:51 devstack sudo[103057]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6e5e55da-57df-4a0e-bcf1-424f899d93f0" returned: 0 in 0.266s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:14:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb663af1-f1ff-42fe-ace0-2146780c1f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e5e55da-57df-4a0e-bcf1-424f899d93f0', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b00327-aaf0-4cff-9dac-cab0056aa5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:51 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Volume volume-6e5e55da-57df-4a0e-bcf1-424f899d93f0 (6e5e55da-57df-4a0e-bcf1-424f899d93f0): created successfully
Sep 07 18:14:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b00327-aaf0-4cff-9dac-cab0056aa5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:51 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Flow 'volume_create_manager' (dc67cc66-095f-47c0-ac84-82aec1ec979e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:51 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2cc8ce90-f024-4c32-86cd-8e1fd48d92ca tempest-VolumesGetTest-1746761850 None] Created volume successfully.
Sep 07 18:14:52 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:14:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Flow 'volume_create_manager' (43ff1160-b17f-478e-ba03-8ce59b240d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1524c568-b540-4c56-bb95-6b354dcc0e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1524c568-b540-4c56-bb95-6b354dcc0e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-276526963',display_name='tempest-VolumesGetTest-Volume-2038582052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=183d32ef-d662-4688-ae41-1decc2675846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84dca37f99b6486f851b723b43204eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:52Z,use_quota=True,user_id='9cf71f6feb154a4bbddeb955c187e666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3ff04e-804b-4b88-b3b7-f44bf198b3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3ff04e-804b-4b88-b3b7-f44bf198b3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e96d82-b5d8-4e4f-a33f-c615d52a1237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e96d82-b5d8-4e4f-a33f-c615d52a1237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '183d32ef-d662-4688-ae41-1decc2675846', 'volume_name': 'volume-183d32ef-d662-4688-ae41-1decc2675846', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (654aff0f-7ba0-456b-b2b7-b95085fbde4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (654aff0f-7ba0-456b-b2b7-b95085fbde4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb51a2c2-8e13-4db1-afb7-b51d903f0d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:52 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Volume 183d32ef-d662-4688-ae41-1decc2675846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-183d32ef-d662-4688-ae41-1decc2675846', 'volume_size': 1}
Sep 07 18:14:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-276526963',display_name='tempest-VolumesGetTest-Volume-2038582052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=183d32ef-d662-4688-ae41-1decc2675846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84dca37f99b6486f851b723b43204eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:52Z,use_quota=True,user_id='9cf71f6feb154a4bbddeb955c187e666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:14:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Creating volume 183d32ef-d662-4688-ae41-1decc2675846 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:14:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:14:52 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:14:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-183d32ef-d662-4688-ae41-1decc2675846 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:52 devstack sudo[103060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-183d32ef-d662-4688-ae41-1decc2675846 1073741824
Sep 07 18:14:52 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:52 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-183d32ef-d662-4688-ae41-1decc2675846 1073741824" returned: 0 in 0.393s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-183d32ef-d662-4688-ae41-1decc2675846 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:52 devstack sudo[103065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-183d32ef-d662-4688-ae41-1decc2675846
Sep 07 18:14:52 devstack sudo[103065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:53 devstack sudo[103065]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-183d32ef-d662-4688-ae41-1decc2675846" returned: 0 in 0.235s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] <== create_volume: return (665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:14:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.668s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb51a2c2-8e13-4db1-afb7-b51d903f0d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-183d32ef-d662-4688-ae41-1decc2675846', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b5829f-da4c-49ed-8c91-f0d59a32296b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:53 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Volume volume-183d32ef-d662-4688-ae41-1decc2675846 (183d32ef-d662-4688-ae41-1decc2675846): created successfully
Sep 07 18:14:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b5829f-da4c-49ed-8c91-f0d59a32296b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Flow 'volume_create_manager' (43ff1160-b17f-478e-ba03-8ce59b240d7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:53 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-633af0a3-6c1b-4922-94ee-59860460e59d tempest-VolumesGetTest-1746761850 None] Created volume successfully.
Sep 07 18:14:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f47e0cdc-fd4d-45a7-a191-762c668c46ce tempest-VolumesGetTest-1746761850 None] Acquiring lock "cinder-183d32ef-d662-4688-ae41-1decc2675846-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f47e0cdc-fd4d-45a7-a191-762c668c46ce tempest-VolumesGetTest-1746761850 None] Lock "cinder-183d32ef-d662-4688-ae41-1decc2675846-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f47e0cdc-fd4d-45a7-a191-762c668c46ce tempest-VolumesGetTest-1746761850 None] Acquiring lock "cinder-quobyte-183d32ef-d662-4688-ae41-1decc2675846" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:53 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f47e0cdc-fd4d-45a7-a191-762c668c46ce tempest-VolumesGetTest-1746761850 None] Lock "cinder-quobyte-183d32ef-d662-4688-ae41-1decc2675846" acquired by "delete_volume" :: waited 0.013s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:53 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eda62b4-a9e9-4522-92a4-4f1756ccfa92]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f47e0cdc-fd4d-45a7-a191-762c668c46ce tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-183d32ef-d662-4688-ae41-1decc2675846 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:53 devstack sudo[103068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-183d32ef-d662-4688-ae41-1decc2675846
Sep 07 18:14:53 devstack sudo[103068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:53 devstack sudo[103068]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f47e0cdc-fd4d-45a7-a191-762c668c46ce tempest-VolumesGetTest-1746761850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-183d32ef-d662-4688-ae41-1decc2675846" returned: 0 in 0.361s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f47e0cdc-fd4d-45a7-a191-762c668c46ce tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-183d32ef-d662-4688-ae41-1decc2675846 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:53 devstack sudo[103073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-183d32ef-d662-4688-ae41-1decc2675846
Sep 07 18:14:53 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:54 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f47e0cdc-fd4d-45a7-a191-762c668c46ce tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-183d32ef-d662-4688-ae41-1decc2675846" returned: 0 in 0.237s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f47e0cdc-fd4d-45a7-a191-762c668c46ce tempest-VolumesGetTest-1746761850 None] Lock "cinder-quobyte-183d32ef-d662-4688-ae41-1decc2675846" released by "delete_volume" :: held 0.638s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:54 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-f47e0cdc-fd4d-45a7-a191-762c668c46ce tempest-VolumesGetTest-1746761850 None] Created reservations ['34cbe14e-68d9-4074-ad2a-25de2d3b757b', '528905d8-18ea-4ca0-bb9c-70f0ab1f7ef9', '46bdcfd1-91ba-4f7e-b81b-33528021298b', 'f43fdb8c-5265-4117-a2c6-72f3bc6b0d14'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:14:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f47e0cdc-fd4d-45a7-a191-762c668c46ce tempest-VolumesGetTest-1746761850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f47e0cdc-fd4d-45a7-a191-762c668c46ce tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f47e0cdc-fd4d-45a7-a191-762c668c46ce tempest-VolumesGetTest-1746761850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:54 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f47e0cdc-fd4d-45a7-a191-762c668c46ce tempest-VolumesGetTest-1746761850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f47e0cdc-fd4d-45a7-a191-762c668c46ce tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f47e0cdc-fd4d-45a7-a191-762c668c46ce tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:54 devstack sudo[103076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:14:54 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:54 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f47e0cdc-fd4d-45a7-a191-762c668c46ce tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.238s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:54 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f47e0cdc-fd4d-45a7-a191-762c668c46ce tempest-VolumesGetTest-1746761850 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:14:54 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f47e0cdc-fd4d-45a7-a191-762c668c46ce tempest-VolumesGetTest-1746761850 None] Deleted volume successfully.
Sep 07 18:14:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f47e0cdc-fd4d-45a7-a191-762c668c46ce tempest-VolumesGetTest-1746761850 None] Lock "cinder-183d32ef-d662-4688-ae41-1decc2675846-delete_volume" released by "delete_volume" :: held 1.052s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-978c252e-42ed-4925-a55a-2e9430634fc9 tempest-VolumesGetTest-1746761850 None] Acquiring lock "cinder-6e5e55da-57df-4a0e-bcf1-424f899d93f0-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-978c252e-42ed-4925-a55a-2e9430634fc9 tempest-VolumesGetTest-1746761850 None] Lock "cinder-6e5e55da-57df-4a0e-bcf1-424f899d93f0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-978c252e-42ed-4925-a55a-2e9430634fc9 tempest-VolumesGetTest-1746761850 None] Acquiring lock "cinder-quobyte-6e5e55da-57df-4a0e-bcf1-424f899d93f0" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-978c252e-42ed-4925-a55a-2e9430634fc9 tempest-VolumesGetTest-1746761850 None] Lock "cinder-quobyte-6e5e55da-57df-4a0e-bcf1-424f899d93f0" acquired by "delete_volume" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:54 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca32ae7-b4fe-46f2-8222-9fa70212d6dd]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-978c252e-42ed-4925-a55a-2e9430634fc9 tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6e5e55da-57df-4a0e-bcf1-424f899d93f0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:54 devstack sudo[103079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6e5e55da-57df-4a0e-bcf1-424f899d93f0
Sep 07 18:14:54 devstack sudo[103079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:55 devstack sudo[103079]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-978c252e-42ed-4925-a55a-2e9430634fc9 tempest-VolumesGetTest-1746761850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6e5e55da-57df-4a0e-bcf1-424f899d93f0" returned: 0 in 0.344s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-978c252e-42ed-4925-a55a-2e9430634fc9 tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6e5e55da-57df-4a0e-bcf1-424f899d93f0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:55 devstack sudo[103084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6e5e55da-57df-4a0e-bcf1-424f899d93f0
Sep 07 18:14:55 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:55 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-978c252e-42ed-4925-a55a-2e9430634fc9 tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6e5e55da-57df-4a0e-bcf1-424f899d93f0" returned: 0 in 0.239s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-978c252e-42ed-4925-a55a-2e9430634fc9 tempest-VolumesGetTest-1746761850 None] Lock "cinder-quobyte-6e5e55da-57df-4a0e-bcf1-424f899d93f0" released by "delete_volume" :: held 0.620s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:55 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-978c252e-42ed-4925-a55a-2e9430634fc9 tempest-VolumesGetTest-1746761850 None] Created reservations ['d6bf2287-0e53-4dc1-b41b-0e161bdd67d3', 'fe00f254-e103-4c84-be0a-1e2605b3ae7f', '0794a8cf-fc91-4e07-93dd-0ad5f812e9e4', 'b437d448-7070-4277-925f-50cd7300d80b'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:14:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-978c252e-42ed-4925-a55a-2e9430634fc9 tempest-VolumesGetTest-1746761850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-978c252e-42ed-4925-a55a-2e9430634fc9 tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-978c252e-42ed-4925-a55a-2e9430634fc9 tempest-VolumesGetTest-1746761850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-978c252e-42ed-4925-a55a-2e9430634fc9 tempest-VolumesGetTest-1746761850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-978c252e-42ed-4925-a55a-2e9430634fc9 tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-978c252e-42ed-4925-a55a-2e9430634fc9 tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:55 devstack sudo[103087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:14:55 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:55 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-978c252e-42ed-4925-a55a-2e9430634fc9 tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.241s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:55 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-978c252e-42ed-4925-a55a-2e9430634fc9 tempest-VolumesGetTest-1746761850 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:14:55 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-978c252e-42ed-4925-a55a-2e9430634fc9 tempest-VolumesGetTest-1746761850 None] Deleted volume successfully.
Sep 07 18:14:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-978c252e-42ed-4925-a55a-2e9430634fc9 tempest-VolumesGetTest-1746761850 None] Lock "cinder-6e5e55da-57df-4a0e-bcf1-424f899d93f0-delete_volume" released by "delete_volume" :: held 1.037s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Flow 'volume_create_manager' (df2a1fc2-7c51-4547-bed4-56908aa064dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6a1aa7-8946-4ff0-8427-c7b48e6dc069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6a1aa7-8946-4ff0-8427-c7b48e6dc069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1409890430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c50e02f0-6727-40e2-a9cc-f1fa6de49542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84dca37f99b6486f851b723b43204eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:56Z,use_quota=True,user_id='9cf71f6feb154a4bbddeb955c187e666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a299ecb-f4f5-4aab-8444-d7c603fb630d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a299ecb-f4f5-4aab-8444-d7c603fb630d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd17682d-03ad-4308-a2bc-0a08066f3c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd17682d-03ad-4308-a2bc-0a08066f3c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c50e02f0-6727-40e2-a9cc-f1fa6de49542', 'volume_name': 'volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bbdc63f-257a-4837-bf49-e69a73f759ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bbdc63f-257a-4837-bf49-e69a73f759ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (582b6b58-d56a-419b-999e-dbf8a988c1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:56 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Volume c50e02f0-6727-40e2-a9cc-f1fa6de49542: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542', 'volume_size': 1}
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1409890430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c50e02f0-6727-40e2-a9cc-f1fa6de49542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84dca37f99b6486f851b723b43204eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:56Z,use_quota=True,user_id='9cf71f6feb154a4bbddeb955c187e666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Creating volume c50e02f0-6727-40e2-a9cc-f1fa6de49542 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:14:56 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:56 devstack sudo[103091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542 1073741824
Sep 07 18:14:56 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:56 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542 1073741824" returned: 0 in 0.403s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:56 devstack sudo[103097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542
Sep 07 18:14:56 devstack sudo[103097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:56 devstack sudo[103097]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542" returned: 0 in 0.245s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (582b6b58-d56a-419b-999e-dbf8a988c1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffed9c46-515e-45ac-a631-1387f5d5c695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:57 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Volume volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542 (c50e02f0-6727-40e2-a9cc-f1fa6de49542): created successfully
Sep 07 18:14:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffed9c46-515e-45ac-a631-1387f5d5c695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Flow 'volume_create_manager' (df2a1fc2-7c51-4547-bed4-56908aa064dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:57 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-319866be-72a2-4caa-be09-c409d5e75b2e tempest-VolumesGetTest-1746761850 None] Created volume successfully.
Sep 07 18:14:57 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:14:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Flow 'volume_create_manager' (5a1b9d7e-e4ee-40ee-a5c5-6b5ebceda5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:14:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ebc689-6f4d-45fa-b27e-cb478b30cb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ebc689-6f4d-45fa-b27e-cb478b30cb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-300744995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e4ad8d2-b462-4ec9-984e-459f37434975,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='84dca37f99b6486f851b723b43204eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=c50e02f0-6727-40e2-a9cc-f1fa6de49542,status='creating',terminated_at=None,updated_at=2026-09-07T16:14:58Z,use_quota=True,user_id='9cf71f6feb154a4bbddeb955c187e666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc273dfb-80cb-4998-8180-240fbffd7df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc273dfb-80cb-4998-8180-240fbffd7df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9cc8b7b-896e-4d62-b4af-b5d049648aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9cc8b7b-896e-4d62-b4af-b5d049648aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1e4ad8d2-b462-4ec9-984e-459f37434975', 'volume_name': 'volume-1e4ad8d2-b462-4ec9-984e-459f37434975', 'volume_size': 1, 'source_volid': 'c50e02f0-6727-40e2-a9cc-f1fa6de49542', 'source_volstatus': 'available'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a9cf7f-30e4-4410-854d-b2e47bcd76ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a9cf7f-30e4-4410-854d-b2e47bcd76ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:14:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9a6616-2f83-4c1c-a81b-cb5e90564703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:14:57 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Volume 1e4ad8d2-b462-4ec9-984e-459f37434975: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1e4ad8d2-b462-4ec9-984e-459f37434975', 'volume_size': 1, 'source_volid': 'c50e02f0-6727-40e2-a9cc-f1fa6de49542', 'source_volstatus': 'available'}
Sep 07 18:14:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:57 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Cloning volume c50e02f0-6727-40e2-a9cc-f1fa6de49542 to volume 1e4ad8d2-b462-4ec9-984e-459f37434975
Sep 07 18:14:57 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Creating offline snapshot 263ca3ec-d517-4769-83fb-f7c34c3579f2 of volume c50e02f0-6727-40e2-a9cc-f1fa6de49542 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:14:57 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b668b11-37c8-44f9-89da-19dc4d82341d]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:57 devstack sudo[103100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542
Sep 07 18:14:57 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:58 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542" returned: 0 in 0.347s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.263ca3ec-d517-4769-83fb-f7c34c3579f2 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:58 devstack sudo[103105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.263ca3ec-d517-4769-83fb-f7c34c3579f2 1G
Sep 07 18:14:58 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:58 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.263ca3ec-d517-4769-83fb-f7c34c3579f2 1G" returned: 0 in 0.381s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.263ca3ec-d517-4769-83fb-f7c34c3579f2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:58 devstack sudo[103110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.263ca3ec-d517-4769-83fb-f7c34c3579f2
Sep 07 18:14:58 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:58 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.263ca3ec-d517-4769-83fb-f7c34c3579f2" returned: 0 in 0.278s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:58 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.263ca3ec-d517-4769-83fb-f7c34c3579f2 is being set with open permissions: ugo+rw
Sep 07 18:14:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.263ca3ec-d517-4769-83fb-f7c34c3579f2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:58 devstack sudo[103115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.263ca3ec-d517-4769-83fb-f7c34c3579f2
Sep 07 18:14:58 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:59 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.263ca3ec-d517-4769-83fb-f7c34c3579f2" returned: 0 in 0.236s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:59 devstack sudo[103118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.info
Sep 07 18:14:59 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:59 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.info" returned: 0 in 0.245s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:59 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.info is being set with open permissions: ugo+rw
Sep 07 18:14:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:59 devstack sudo[103121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.info
Sep 07 18:14:59 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:59 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.info" returned: 0 in 0.231s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Acquiring lock "cinder-quobyte-1e4ad8d2-b462-4ec9-984e-459f37434975" by "_copy_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:14:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Lock "cinder-quobyte-1e4ad8d2-b462-4ec9-984e-459f37434975" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:14:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] snapshot: 263ca3ec-d517-4769-83fb-f7c34c3579f2, volume: 1e4ad8d2-b462-4ec9-984e-459f37434975,  {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 07 18:14:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:14:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:14:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:14:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:14:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:14:59 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[474a9cf8-2c75-471e-95a0-7928ca6b4095]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:14:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.263ca3ec-d517-4769-83fb-f7c34c3579f2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:14:59 devstack sudo[103124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.263ca3ec-d517-4769-83fb-f7c34c3579f2
Sep 07 18:14:59 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:14:59 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root
Sep 07 18:14:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.263ca3ec-d517-4769-83fb-f7c34c3579f2" returned: 0 in 0.345s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:14:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:15:00 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5279b1fc-70bc-42d3-bcdd-ba213873ecce]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:15:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:00 devstack sudo[103129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542
Sep 07 18:15:00 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:00 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542" returned: 0 in 0.344s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] will copy from snapshot at /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542 {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 07 18:15:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Creating direct copy from snapshot {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 07 18:15:00 devstack cinder-volume[87269]: DEBUG cinder.utils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Path /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1e4ad8d2-b462-4ec9-984e-459f37434975 not found in is_blk_device check {{(pid=87269) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 07 18:15:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1e4ad8d2-b462-4ec9-984e-459f37434975 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:00 devstack sudo[103134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1e4ad8d2-b462-4ec9-984e-459f37434975
Sep 07 18:15:00 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:00 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:15:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:15:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:15:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:15:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:15:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:15:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:00 devstack sudo[103146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:15:00 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:01 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.830s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:15:01 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:15:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 07 18:15:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread info: [<_MainThread(MainThread, started 137533762306176)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137533650971072)>, <Thread(Thread-3 (stat_writer), started daemon 137533647226880)>, <Thread(Rabbit-heartbeat, started daemon 137533647437120)>, <Thread(Thread-5 (_runner), started daemon 137533648120896)>, <Thread(Thread-7 (_runner), started daemon 137533648182592)>, <Thread(fd_logger, started daemon 137533644336576)>, <Thread(privsep_reader, started daemon 137533643255424)>, <Thread(tpool_thread_0, started daemon 137533635446464)>, <Thread(tpool_thread_1, started daemon 137533627053760)>, <Thread(tpool_thread_2, started daemon 137533618661056)>, <Thread(tpool_thread_3, started daemon 137533610251968)>, <Thread(tpool_thread_4, started daemon 137533601842880)>, <Thread(tpool_thread_5, started daemon 137533593433792)>, <Thread(tpool_thread_6, started daemon 137533585024704)>, <Thread(tpool_thread_7, started daemon 137533576615616)>, <Thread(tpool_thread_8, started daemon 137533568206528)>, <Thread(tpool_thread_9, started daemon 137533559797440)>, <Thread(tpool_thread_10, started daemon 137533551388352)>, <Thread(tpool_thread_11, started daemon 137533542979264)>, <Thread(tpool_thread_12, started daemon 137533534570176)>, <Thread(tpool_thread_13, started daemon 137533526161088)>, <Thread(tpool_thread_14, started daemon 137533517752000)>, <Thread(tpool_thread_15, started daemon 137533509342912)>, <Thread(tpool_thread_16, started daemon 137533500933824)>, <Thread(tpool_thread_17, started daemon 137533492524736)>, <Thread(tpool_thread_18, started daemon 137533484115648)>, <Thread(tpool_thread_19, started daemon 137533475706560)>] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 07 18:15:04 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1e4ad8d2-b462-4ec9-984e-459f37434975" returned: 0 in 4.001s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:04 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Image conversion details: src /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542, size 1024.00 MB, duration 4.00 sec, destination /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1e4ad8d2-b462-4ec9-984e-459f37434975 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 07 18:15:04 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Converted 1024.00 MB image at 255.85 MB/s
Sep 07 18:15:04 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1e4ad8d2-b462-4ec9-984e-459f37434975 is being set with open permissions: ugo+rw
Sep 07 18:15:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1e4ad8d2-b462-4ec9-984e-459f37434975 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:04 devstack sudo[103153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1e4ad8d2-b462-4ec9-984e-459f37434975
Sep 07 18:15:04 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:04 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1e4ad8d2-b462-4ec9-984e-459f37434975" returned: 0 in 0.244s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Lock "cinder-quobyte-1e4ad8d2-b462-4ec9-984e-459f37434975" released by "_copy_volume_from_snapshot" :: held 5.003s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:15:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Acquiring lock "cinder-quobyte-263ca3ec-d517-4769-83fb-f7c34c3579f2" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:15:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Lock "cinder-quobyte-263ca3ec-d517-4769-83fb-f7c34c3579f2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:15:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Deleting offline snapshot 263ca3ec-d517-4769-83fb-f7c34c3579f2 of volume c50e02f0-6727-40e2-a9cc-f1fa6de49542 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:15:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] snapshot_file for this snap is: volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.263ca3ec-d517-4769-83fb-f7c34c3579f2 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:15:04 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a07686-1c7f-4923-be50-02698d3984fc]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:15:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.263ca3ec-d517-4769-83fb-f7c34c3579f2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:04 devstack sudo[103156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.263ca3ec-d517-4769-83fb-f7c34c3579f2
Sep 07 18:15:04 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:05 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.263ca3ec-d517-4769-83fb-f7c34c3579f2" returned: 0 in 0.344s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:15:05 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a647096-5378-496b-ad38-b59df9e654d5]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:15:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:05 devstack sudo[103161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542
Sep 07 18:15:05 devstack sudo[103161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:05 devstack sudo[103161]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542" returned: 0 in 0.535s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.263ca3ec-d517-4769-83fb-f7c34c3579f2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:05 devstack sudo[103166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.263ca3ec-d517-4769-83fb-f7c34c3579f2
Sep 07 18:15:05 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:05 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.263ca3ec-d517-4769-83fb-f7c34c3579f2" returned: 0 in 0.309s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.263ca3ec-d517-4769-83fb-f7c34c3579f2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:05 devstack sudo[103171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.263ca3ec-d517-4769-83fb-f7c34c3579f2
Sep 07 18:15:05 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:06 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542.263ca3ec-d517-4769-83fb-f7c34c3579f2" returned: 0 in 0.232s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Lock "cinder-quobyte-263ca3ec-d517-4769-83fb-f7c34c3579f2" released by "_delete_snapshot" :: held 1.499s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:15:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.403s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:15:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef9a6616-2f83-4c1c-a81b-cb5e90564703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e4ad8d2-b462-4ec9-984e-459f37434975', 'volume_size': 1, 'source_volid': 'c50e02f0-6727-40e2-a9cc-f1fa6de49542', 'source_volstatus': 'available'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:15:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ea539a-d548-49b5-b3b8-8fe20f3d947d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:15:06 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Volume volume-1e4ad8d2-b462-4ec9-984e-459f37434975 (1e4ad8d2-b462-4ec9-984e-459f37434975): created successfully
Sep 07 18:15:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ea539a-d548-49b5-b3b8-8fe20f3d947d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:15:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Flow 'volume_create_manager' (5a1b9d7e-e4ee-40ee-a5c5-6b5ebceda5a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:15:06 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-cda583c9-1712-4a21-bd1b-dfb63b5d31fc tempest-VolumesGetTest-1746761850 None] Created volume successfully.
Sep 07 18:15:07 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:15:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Flow 'volume_create_manager' (ca6f5569-5ab4-417f-8ca0-7dea98342c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1415a6b0-4d1e-4600-ba81-c3647b8fed10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1415a6b0-4d1e-4600-ba81-c3647b8fed10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:15:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1224767278',display_name='tempest-VolumesGetTest-Volume-738520229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19086a6d-b83e-4d69-bdb7-6a183ec327d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84dca37f99b6486f851b723b43204eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:15:08Z,use_quota=True,user_id='9cf71f6feb154a4bbddeb955c187e666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f181906b-2e85-46e8-8582-a381fd7ebf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f181906b-2e85-46e8-8582-a381fd7ebf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee2676e-1534-4543-a21e-e8f31cae1fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee2676e-1534-4543-a21e-e8f31cae1fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19086a6d-b83e-4d69-bdb7-6a183ec327d7', 'volume_name': 'volume-19086a6d-b83e-4d69-bdb7-6a183ec327d7', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05998a9b-3fed-4eb3-b031-0cbd6f15f1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05998a9b-3fed-4eb3-b031-0cbd6f15f1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe1f17e-d8a9-4819-9ebf-26cee59abcbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:15:08 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Volume 19086a6d-b83e-4d69-bdb7-6a183ec327d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19086a6d-b83e-4d69-bdb7-6a183ec327d7', 'volume_size': 1}
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:15:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1224767278',display_name='tempest-VolumesGetTest-Volume-738520229',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19086a6d-b83e-4d69-bdb7-6a183ec327d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84dca37f99b6486f851b723b43204eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:15:08Z,use_quota=True,user_id='9cf71f6feb154a4bbddeb955c187e666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Creating volume 19086a6d-b83e-4d69-bdb7-6a183ec327d7 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:15:08 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-19086a6d-b83e-4d69-bdb7-6a183ec327d7 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:08 devstack sudo[103175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-19086a6d-b83e-4d69-bdb7-6a183ec327d7 1073741824
Sep 07 18:15:08 devstack sudo[103175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:08 devstack sudo[103175]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-19086a6d-b83e-4d69-bdb7-6a183ec327d7 1073741824" returned: 0 in 0.422s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-19086a6d-b83e-4d69-bdb7-6a183ec327d7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:08 devstack sudo[103216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-19086a6d-b83e-4d69-bdb7-6a183ec327d7
Sep 07 18:15:08 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:08 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-19086a6d-b83e-4d69-bdb7-6a183ec327d7" returned: 0 in 0.250s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe1f17e-d8a9-4819-9ebf-26cee59abcbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19086a6d-b83e-4d69-bdb7-6a183ec327d7', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f29b75d-b977-4dc4-9dc9-3e4225ba48eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:15:08 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Volume volume-19086a6d-b83e-4d69-bdb7-6a183ec327d7 (19086a6d-b83e-4d69-bdb7-6a183ec327d7): created successfully
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f29b75d-b977-4dc4-9dc9-3e4225ba48eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:15:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Flow 'volume_create_manager' (ca6f5569-5ab4-417f-8ca0-7dea98342c3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:15:08 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ea078e18-8d02-4c0c-b648-d7e20c2299b0 tempest-VolumesGetTest-1746761850 None] Created volume successfully.
Sep 07 18:15:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4e64f4f0-22c7-4f70-96b6-ec168bf18aa0 tempest-VolumesGetTest-1746761850 None] Acquiring lock "cinder-19086a6d-b83e-4d69-bdb7-6a183ec327d7-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:15:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4e64f4f0-22c7-4f70-96b6-ec168bf18aa0 tempest-VolumesGetTest-1746761850 None] Lock "cinder-19086a6d-b83e-4d69-bdb7-6a183ec327d7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:15:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4e64f4f0-22c7-4f70-96b6-ec168bf18aa0 tempest-VolumesGetTest-1746761850 None] Acquiring lock "cinder-quobyte-19086a6d-b83e-4d69-bdb7-6a183ec327d7" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:15:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4e64f4f0-22c7-4f70-96b6-ec168bf18aa0 tempest-VolumesGetTest-1746761850 None] Lock "cinder-quobyte-19086a6d-b83e-4d69-bdb7-6a183ec327d7" acquired by "delete_volume" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:15:09 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce25d2a6-5281-4e41-a821-baa3e0050879]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:15:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4e64f4f0-22c7-4f70-96b6-ec168bf18aa0 tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-19086a6d-b83e-4d69-bdb7-6a183ec327d7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:09 devstack sudo[103219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-19086a6d-b83e-4d69-bdb7-6a183ec327d7
Sep 07 18:15:09 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:09 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4e64f4f0-22c7-4f70-96b6-ec168bf18aa0 tempest-VolumesGetTest-1746761850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-19086a6d-b83e-4d69-bdb7-6a183ec327d7" returned: 0 in 0.347s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4e64f4f0-22c7-4f70-96b6-ec168bf18aa0 tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-19086a6d-b83e-4d69-bdb7-6a183ec327d7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:09 devstack sudo[103224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-19086a6d-b83e-4d69-bdb7-6a183ec327d7
Sep 07 18:15:09 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:09 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4e64f4f0-22c7-4f70-96b6-ec168bf18aa0 tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-19086a6d-b83e-4d69-bdb7-6a183ec327d7" returned: 0 in 0.240s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4e64f4f0-22c7-4f70-96b6-ec168bf18aa0 tempest-VolumesGetTest-1746761850 None] Lock "cinder-quobyte-19086a6d-b83e-4d69-bdb7-6a183ec327d7" released by "delete_volume" :: held 0.624s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:15:09 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-4e64f4f0-22c7-4f70-96b6-ec168bf18aa0 tempest-VolumesGetTest-1746761850 None] Created reservations ['1122b1f8-20b1-4572-ac60-2ecade96ce82', '899f52d9-cfcc-4a2c-862b-a7a1ef4f3037', 'ab87f5b8-0a4d-4b48-a58b-125f7a7c6266', '998fb2ef-0596-4ac0-a3fe-8fcfc696ed90'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:15:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4e64f4f0-22c7-4f70-96b6-ec168bf18aa0 tempest-VolumesGetTest-1746761850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:15:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4e64f4f0-22c7-4f70-96b6-ec168bf18aa0 tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:15:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4e64f4f0-22c7-4f70-96b6-ec168bf18aa0 tempest-VolumesGetTest-1746761850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:15:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4e64f4f0-22c7-4f70-96b6-ec168bf18aa0 tempest-VolumesGetTest-1746761850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:15:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4e64f4f0-22c7-4f70-96b6-ec168bf18aa0 tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:15:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4e64f4f0-22c7-4f70-96b6-ec168bf18aa0 tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:09 devstack sudo[103227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:15:09 devstack sudo[103227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:10 devstack sudo[103227]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4e64f4f0-22c7-4f70-96b6-ec168bf18aa0 tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.241s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:10 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-4e64f4f0-22c7-4f70-96b6-ec168bf18aa0 tempest-VolumesGetTest-1746761850 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:15:10 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4e64f4f0-22c7-4f70-96b6-ec168bf18aa0 tempest-VolumesGetTest-1746761850 None] Deleted volume successfully.
Sep 07 18:15:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4e64f4f0-22c7-4f70-96b6-ec168bf18aa0 tempest-VolumesGetTest-1746761850 None] Lock "cinder-19086a6d-b83e-4d69-bdb7-6a183ec327d7-delete_volume" released by "delete_volume" :: held 1.032s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:15:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0a6f84d5-8b0b-4221-b0b5-2350bfe3bbe1 tempest-VolumesGetTest-1746761850 None] Acquiring lock "cinder-1e4ad8d2-b462-4ec9-984e-459f37434975-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:15:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0a6f84d5-8b0b-4221-b0b5-2350bfe3bbe1 tempest-VolumesGetTest-1746761850 None] Lock "cinder-1e4ad8d2-b462-4ec9-984e-459f37434975-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:15:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0a6f84d5-8b0b-4221-b0b5-2350bfe3bbe1 tempest-VolumesGetTest-1746761850 None] Acquiring lock "cinder-quobyte-1e4ad8d2-b462-4ec9-984e-459f37434975" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:15:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0a6f84d5-8b0b-4221-b0b5-2350bfe3bbe1 tempest-VolumesGetTest-1746761850 None] Lock "cinder-quobyte-1e4ad8d2-b462-4ec9-984e-459f37434975" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:15:10 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3541f5fd-2ef2-4bc9-9f8a-c74e73bd5d91]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:15:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0a6f84d5-8b0b-4221-b0b5-2350bfe3bbe1 tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1e4ad8d2-b462-4ec9-984e-459f37434975 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:10 devstack sudo[103230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1e4ad8d2-b462-4ec9-984e-459f37434975
Sep 07 18:15:10 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:10 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0a6f84d5-8b0b-4221-b0b5-2350bfe3bbe1 tempest-VolumesGetTest-1746761850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1e4ad8d2-b462-4ec9-984e-459f37434975" returned: 0 in 0.339s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0a6f84d5-8b0b-4221-b0b5-2350bfe3bbe1 tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1e4ad8d2-b462-4ec9-984e-459f37434975 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:10 devstack sudo[103235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1e4ad8d2-b462-4ec9-984e-459f37434975
Sep 07 18:15:10 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:10 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0a6f84d5-8b0b-4221-b0b5-2350bfe3bbe1 tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1e4ad8d2-b462-4ec9-984e-459f37434975" returned: 0 in 0.237s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0a6f84d5-8b0b-4221-b0b5-2350bfe3bbe1 tempest-VolumesGetTest-1746761850 None] Lock "cinder-quobyte-1e4ad8d2-b462-4ec9-984e-459f37434975" released by "delete_volume" :: held 0.611s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:15:11 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-0a6f84d5-8b0b-4221-b0b5-2350bfe3bbe1 tempest-VolumesGetTest-1746761850 None] Created reservations ['3d0d64db-2674-45e6-a304-ee0b9404af73', '6f543d8c-2771-4006-af55-9633542e4019', '70bcc983-f87a-4302-afad-57500ca93add', '0dd6d77f-7eb0-4361-a9e8-d9ff62bd6fec'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:15:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0a6f84d5-8b0b-4221-b0b5-2350bfe3bbe1 tempest-VolumesGetTest-1746761850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:15:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0a6f84d5-8b0b-4221-b0b5-2350bfe3bbe1 tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:15:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0a6f84d5-8b0b-4221-b0b5-2350bfe3bbe1 tempest-VolumesGetTest-1746761850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:15:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0a6f84d5-8b0b-4221-b0b5-2350bfe3bbe1 tempest-VolumesGetTest-1746761850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:15:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0a6f84d5-8b0b-4221-b0b5-2350bfe3bbe1 tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:15:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0a6f84d5-8b0b-4221-b0b5-2350bfe3bbe1 tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:11 devstack sudo[103238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:15:11 devstack sudo[103238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:11 devstack sudo[103238]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0a6f84d5-8b0b-4221-b0b5-2350bfe3bbe1 tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.235s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:11 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-0a6f84d5-8b0b-4221-b0b5-2350bfe3bbe1 tempest-VolumesGetTest-1746761850 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:15:11 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0a6f84d5-8b0b-4221-b0b5-2350bfe3bbe1 tempest-VolumesGetTest-1746761850 None] Deleted volume successfully.
Sep 07 18:15:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0a6f84d5-8b0b-4221-b0b5-2350bfe3bbe1 tempest-VolumesGetTest-1746761850 None] Lock "cinder-1e4ad8d2-b462-4ec9-984e-459f37434975-delete_volume" released by "delete_volume" :: held 1.028s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:15:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-89a48f9c-f4d1-4e16-aaed-8d347175846e tempest-VolumesGetTest-1746761850 None] Acquiring lock "cinder-c50e02f0-6727-40e2-a9cc-f1fa6de49542-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:15:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-89a48f9c-f4d1-4e16-aaed-8d347175846e tempest-VolumesGetTest-1746761850 None] Lock "cinder-c50e02f0-6727-40e2-a9cc-f1fa6de49542-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:15:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-89a48f9c-f4d1-4e16-aaed-8d347175846e tempest-VolumesGetTest-1746761850 None] Acquiring lock "cinder-quobyte-c50e02f0-6727-40e2-a9cc-f1fa6de49542" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:15:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-89a48f9c-f4d1-4e16-aaed-8d347175846e tempest-VolumesGetTest-1746761850 None] Lock "cinder-quobyte-c50e02f0-6727-40e2-a9cc-f1fa6de49542" acquired by "delete_volume" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:15:11 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb46635a-1880-4c70-81df-82d33f9d5533]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:15:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-89a48f9c-f4d1-4e16-aaed-8d347175846e tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:11 devstack sudo[103241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542
Sep 07 18:15:11 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:11 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-89a48f9c-f4d1-4e16-aaed-8d347175846e tempest-VolumesGetTest-1746761850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542" returned: 0 in 0.346s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-89a48f9c-f4d1-4e16-aaed-8d347175846e tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:12 devstack sudo[103246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542
Sep 07 18:15:12 devstack sudo[103246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:12 devstack sudo[103246]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-89a48f9c-f4d1-4e16-aaed-8d347175846e tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c50e02f0-6727-40e2-a9cc-f1fa6de49542" returned: 0 in 0.238s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-89a48f9c-f4d1-4e16-aaed-8d347175846e tempest-VolumesGetTest-1746761850 None] Lock "cinder-quobyte-c50e02f0-6727-40e2-a9cc-f1fa6de49542" released by "delete_volume" :: held 0.635s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:15:12 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-89a48f9c-f4d1-4e16-aaed-8d347175846e tempest-VolumesGetTest-1746761850 None] Created reservations ['a1224d6a-9830-4387-b8a5-b20e19eaf213', 'f43684d1-4555-4f8f-8cd7-6d4e33144f48', '2bcaff48-aa56-4296-a0a9-fd508b872381', 'a65d94c1-0993-4e68-8f89-1604727bab03'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:15:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-89a48f9c-f4d1-4e16-aaed-8d347175846e tempest-VolumesGetTest-1746761850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:15:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-89a48f9c-f4d1-4e16-aaed-8d347175846e tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:15:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-89a48f9c-f4d1-4e16-aaed-8d347175846e tempest-VolumesGetTest-1746761850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:15:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-89a48f9c-f4d1-4e16-aaed-8d347175846e tempest-VolumesGetTest-1746761850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:15:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-89a48f9c-f4d1-4e16-aaed-8d347175846e tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:15:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-89a48f9c-f4d1-4e16-aaed-8d347175846e tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:12 devstack sudo[103249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:15:12 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:12 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-89a48f9c-f4d1-4e16-aaed-8d347175846e tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.245s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:12 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-89a48f9c-f4d1-4e16-aaed-8d347175846e tempest-VolumesGetTest-1746761850 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:15:12 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-89a48f9c-f4d1-4e16-aaed-8d347175846e tempest-VolumesGetTest-1746761850 None] Deleted volume successfully.
Sep 07 18:15:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-89a48f9c-f4d1-4e16-aaed-8d347175846e tempest-VolumesGetTest-1746761850 None] Lock "cinder-c50e02f0-6727-40e2-a9cc-f1fa6de49542-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:15:13 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:15:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Flow 'volume_create_manager' (6e830a45-6ca0-48f8-a344-7995ff34e7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:15:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cd580bf-ed38-4d1f-b083-9367446e1549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:15:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cd580bf-ed38-4d1f-b083-9367446e1549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1438595596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ccf69ec-87c3-400e-ac6b-b118d4c1819b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='84dca37f99b6486f851b723b43204eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:15:13Z,use_quota=True,user_id='9cf71f6feb154a4bbddeb955c187e666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:15:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d922053-e87b-4e84-a9c4-4582f9fd97c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:15:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d922053-e87b-4e84-a9c4-4582f9fd97c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:15:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20591670-d349-425a-88e2-ef6c0ad2a6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:15:13 devstack cinder-volume[87269]: DEBUG cinder.image.glance [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Creating Keystone auth plugin from conf {{(pid=87269) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 07 18:15:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20591670-d349-425a-88e2-ef6c0ad2a6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9ccf69ec-87c3-400e-ac6b-b118d4c1819b', 'volume_name': 'volume-9ccf69ec-87c3-400e-ac6b-b118d4c1819b', 'volume_size': 1, 'image_id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72845066d7f346c6b304e9cfe8bcc9a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'created_at': datetime.datetime(2026, 9, 7, 15, 54, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d16015e16d0>}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:15:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e854e1a4-1c58-48c3-be76-6d5c2f509251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:15:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e854e1a4-1c58-48c3-be76-6d5c2f509251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:15:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de96e635-a914-43a0-a1d9-10ad7f074729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:15:13 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Volume 9ccf69ec-87c3-400e-ac6b-b118d4c1819b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9ccf69ec-87c3-400e-ac6b-b118d4c1819b', 'volume_size': 1, 'image_id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72845066d7f346c6b304e9cfe8bcc9a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'created_at': datetime.datetime(2026, 9, 7, 15, 54, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d16015e16d0>}
Sep 07 18:15:13 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Trying to clone 9ccf69ec-87c3-400e-ac6b-b118d4c1819b from image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}]). {{(pid=87269) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 07 18:15:14 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_vep_9ak0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 07 18:15:14 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Image download 20.69 MB at 20.69 MB/s
Sep 07 18:15:14 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2dbdba-2648-4377-b51c-9241b6274595]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:15:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_vep_9ak0devstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:14 devstack sudo[103253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_vep_9ak0devstack@QuobyteHD
Sep 07 18:15:14 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:14 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_vep_9ak0devstack@QuobyteHD" returned: 0 in 0.328s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:14 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Temporary image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 is fetched for user 9cf71f6feb154a4bbddeb955c187e666. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 07 18:15:14 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0cd07f-5901-4374-8e98-29197f92b6fb]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:15:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_vep_9ak0devstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:14 devstack sudo[103258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_vep_9ak0devstack@QuobyteHD
Sep 07 18:15:14 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:14 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_vep_9ak0devstack@QuobyteHD" returned: 0 in 0.323s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:15:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:15:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1438595596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ccf69ec-87c3-400e-ac6b-b118d4c1819b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='84dca37f99b6486f851b723b43204eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:15:13Z,use_quota=True,user_id='9cf71f6feb154a4bbddeb955c187e666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:15:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Creating volume 9ccf69ec-87c3-400e-ac6b-b118d4c1819b {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:15:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:15:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:15:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:15:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:15:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:15:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:15:14 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:15:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ccf69ec-87c3-400e-ac6b-b118d4c1819b 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:14 devstack sudo[103263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ccf69ec-87c3-400e-ac6b-b118d4c1819b 1073741824
Sep 07 18:15:14 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:15 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ccf69ec-87c3-400e-ac6b-b118d4c1819b 1073741824" returned: 0 in 0.385s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ccf69ec-87c3-400e-ac6b-b118d4c1819b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:15 devstack sudo[103269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ccf69ec-87c3-400e-ac6b-b118d4c1819b
Sep 07 18:15:15 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:15 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ccf69ec-87c3-400e-ac6b-b118d4c1819b" returned: 0 in 0.242s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:15:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:15:15 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Attempting download of 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 ((None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}])) to volume 9ccf69ec-87c3-400e-ac6b-b118d4c1819b. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 07 18:15:15 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd6fa88-5904-4400-8e4e-623949413217]: (4, 'raw') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:15:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_2q_9plqn {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:15 devstack sudo[103272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_2q_9plqn
Sep 07 18:15:15 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:15 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_2q_9plqn" returned: 0 in 0.312s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_2q_9plqn {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:15 devstack sudo[103276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_2q_9plqn
Sep 07 18:15:15 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:16 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_2q_9plqn" returned: 1 in 0.306s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_2q_9plqn' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 07 18:15:16 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e203fa0-bd17-4595-863c-42d22fdf2696]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:15:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_vep_9ak0devstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:16 devstack sudo[103280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_vep_9ak0devstack@QuobyteHD
Sep 07 18:15:16 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:16 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_vep_9ak0devstack@QuobyteHD" returned: 0 in 0.317s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:16 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 was qcow2, converting to qcow2 {{(pid=87269) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 07 18:15:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_vep_9ak0devstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ccf69ec-87c3-400e-ac6b-b118d4c1819b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:16 devstack sudo[103286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_vep_9ak0devstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ccf69ec-87c3-400e-ac6b-b118d4c1819b
Sep 07 18:15:16 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:17 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_vep_9ak0devstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ccf69ec-87c3-400e-ac6b-b118d4c1819b" returned: 0 in 1.463s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:17 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3_vep_9ak0devstack@QuobyteHD, size 112.00 MB, duration 1.46 sec, destination /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ccf69ec-87c3-400e-ac6b-b118d4c1819b {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 07 18:15:17 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Converted 112.00 MB image at 76.51 MB/s
Sep 07 18:15:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ccf69ec-87c3-400e-ac6b-b118d4c1819b 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:17 devstack sudo[103296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ccf69ec-87c3-400e-ac6b-b118d4c1819b 1G
Sep 07 18:15:17 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:18 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ccf69ec-87c3-400e-ac6b-b118d4c1819b 1G" returned: 0 in 0.300s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:18 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Downloaded image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 ((None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}])) to volume 9ccf69ec-87c3-400e-ac6b-b118d4c1819b successfully. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 07 18:15:18 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Temporary image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 for user 9cf71f6feb154a4bbddeb955c187e666 is deleted. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 07 18:15:18 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Marking volume 9ccf69ec-87c3-400e-ac6b-b118d4c1819b as bootable. {{(pid=87269) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 07 18:15:18 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Copying metadata from image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 to 9ccf69ec-87c3-400e-ac6b-b118d4c1819b. {{(pid=87269) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 07 18:15:18 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Creating volume glance metadata for volume 9ccf69ec-87c3-400e-ac6b-b118d4c1819b backed by image 30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87269) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 07 18:15:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de96e635-a914-43a0-a1d9-10ad7f074729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ccf69ec-87c3-400e-ac6b-b118d4c1819b', 'volume_size': 1, 'image_id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72845066d7f346c6b304e9cfe8bcc9a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3', 'created_at': datetime.datetime(2026, 9, 7, 15, 54, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 54, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/30a56d6b-d9f5-4ef9-aef9-4d1ff124bcb3/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d16015e16d0>}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:15:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9144bc17-0613-4288-873f-b5b950caf08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:15:18 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Volume volume-9ccf69ec-87c3-400e-ac6b-b118d4c1819b (9ccf69ec-87c3-400e-ac6b-b118d4c1819b): created successfully
Sep 07 18:15:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9144bc17-0613-4288-873f-b5b950caf08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:15:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Flow 'volume_create_manager' (6e830a45-6ca0-48f8-a344-7995ff34e7e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:15:18 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-54d66854-aeef-4976-9d85-edaae5b3098a tempest-VolumesGetTest-1746761850 None] Created volume successfully.
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Flow 'volume_create_manager' (fe9099ee-6243-4250-883e-985a9cd04aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3957e6-d323-4467-a5af-b02a816552f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3957e6-d323-4467-a5af-b02a816552f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:15:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1798448608',display_name='tempest-VolumesGetTest-Volume-2004474313',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f319b482-6075-4164-80ed-b42da7a920c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84dca37f99b6486f851b723b43204eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:15:19Z,use_quota=True,user_id='9cf71f6feb154a4bbddeb955c187e666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e6289e3-a60f-4918-81e6-845fd6fa8bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e6289e3-a60f-4918-81e6-845fd6fa8bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb78af94-7bf9-435b-9fdc-21dd6e0029fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb78af94-7bf9-435b-9fdc-21dd6e0029fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f319b482-6075-4164-80ed-b42da7a920c1', 'volume_name': 'volume-f319b482-6075-4164-80ed-b42da7a920c1', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c6ee8dc-708a-4130-b7b9-dde94b2c9134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c6ee8dc-708a-4130-b7b9-dde94b2c9134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5aecf64-8813-4890-9b9e-46bf28dd5f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:15:19 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Volume f319b482-6075-4164-80ed-b42da7a920c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f319b482-6075-4164-80ed-b42da7a920c1', 'volume_size': 1}
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:15:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1798448608',display_name='tempest-VolumesGetTest-Volume-2004474313',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f319b482-6075-4164-80ed-b42da7a920c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84dca37f99b6486f851b723b43204eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:15:19Z,use_quota=True,user_id='9cf71f6feb154a4bbddeb955c187e666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Creating volume f319b482-6075-4164-80ed-b42da7a920c1 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:15:19 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f319b482-6075-4164-80ed-b42da7a920c1 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:19 devstack sudo[103301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f319b482-6075-4164-80ed-b42da7a920c1 1073741824
Sep 07 18:15:19 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:19 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f319b482-6075-4164-80ed-b42da7a920c1 1073741824" returned: 0 in 0.394s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f319b482-6075-4164-80ed-b42da7a920c1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:19 devstack sudo[103307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f319b482-6075-4164-80ed-b42da7a920c1
Sep 07 18:15:19 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:19 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f319b482-6075-4164-80ed-b42da7a920c1" returned: 0 in 0.240s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5aecf64-8813-4890-9b9e-46bf28dd5f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f319b482-6075-4164-80ed-b42da7a920c1', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ac9e82-f62b-4e6e-8a82-73ce672311d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:15:19 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Volume volume-f319b482-6075-4164-80ed-b42da7a920c1 (f319b482-6075-4164-80ed-b42da7a920c1): created successfully
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ac9e82-f62b-4e6e-8a82-73ce672311d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:15:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Flow 'volume_create_manager' (fe9099ee-6243-4250-883e-985a9cd04aae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:15:19 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b45bb990-39ed-4e01-bf51-4b33ae2a62c3 tempest-VolumesGetTest-1746761850 None] Created volume successfully.
Sep 07 18:15:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4a09fe30-94d2-4c34-9f52-90f373e68ca1 tempest-VolumesGetTest-1746761850 None] Acquiring lock "cinder-f319b482-6075-4164-80ed-b42da7a920c1-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:15:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4a09fe30-94d2-4c34-9f52-90f373e68ca1 tempest-VolumesGetTest-1746761850 None] Lock "cinder-f319b482-6075-4164-80ed-b42da7a920c1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:15:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4a09fe30-94d2-4c34-9f52-90f373e68ca1 tempest-VolumesGetTest-1746761850 None] Acquiring lock "cinder-quobyte-f319b482-6075-4164-80ed-b42da7a920c1" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:15:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4a09fe30-94d2-4c34-9f52-90f373e68ca1 tempest-VolumesGetTest-1746761850 None] Lock "cinder-quobyte-f319b482-6075-4164-80ed-b42da7a920c1" acquired by "delete_volume" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:15:20 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[29544406-a2dd-4423-ac93-be26ca12ca63]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:15:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4a09fe30-94d2-4c34-9f52-90f373e68ca1 tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f319b482-6075-4164-80ed-b42da7a920c1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:20 devstack sudo[103310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f319b482-6075-4164-80ed-b42da7a920c1
Sep 07 18:15:20 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:20 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4a09fe30-94d2-4c34-9f52-90f373e68ca1 tempest-VolumesGetTest-1746761850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f319b482-6075-4164-80ed-b42da7a920c1" returned: 0 in 0.341s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4a09fe30-94d2-4c34-9f52-90f373e68ca1 tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f319b482-6075-4164-80ed-b42da7a920c1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:20 devstack sudo[103315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f319b482-6075-4164-80ed-b42da7a920c1
Sep 07 18:15:20 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:20 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4a09fe30-94d2-4c34-9f52-90f373e68ca1 tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f319b482-6075-4164-80ed-b42da7a920c1" returned: 0 in 0.235s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4a09fe30-94d2-4c34-9f52-90f373e68ca1 tempest-VolumesGetTest-1746761850 None] Lock "cinder-quobyte-f319b482-6075-4164-80ed-b42da7a920c1" released by "delete_volume" :: held 0.613s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:15:21 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-4a09fe30-94d2-4c34-9f52-90f373e68ca1 tempest-VolumesGetTest-1746761850 None] Created reservations ['b751cafb-70c6-4f27-8932-0207926a3b20', 'f079835a-8597-4c91-b4e3-7dc2f27ce595', '324f4b54-60ab-43a2-ad11-2f2e88c94736', '9282b9f0-aa7d-40ca-aca2-bd270438e50e'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:15:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4a09fe30-94d2-4c34-9f52-90f373e68ca1 tempest-VolumesGetTest-1746761850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:15:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4a09fe30-94d2-4c34-9f52-90f373e68ca1 tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:15:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4a09fe30-94d2-4c34-9f52-90f373e68ca1 tempest-VolumesGetTest-1746761850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:15:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4a09fe30-94d2-4c34-9f52-90f373e68ca1 tempest-VolumesGetTest-1746761850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:15:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4a09fe30-94d2-4c34-9f52-90f373e68ca1 tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:15:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4a09fe30-94d2-4c34-9f52-90f373e68ca1 tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:21 devstack sudo[103318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:15:21 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:21 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4a09fe30-94d2-4c34-9f52-90f373e68ca1 tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.235s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:21 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-4a09fe30-94d2-4c34-9f52-90f373e68ca1 tempest-VolumesGetTest-1746761850 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:15:21 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4a09fe30-94d2-4c34-9f52-90f373e68ca1 tempest-VolumesGetTest-1746761850 None] Deleted volume successfully.
Sep 07 18:15:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4a09fe30-94d2-4c34-9f52-90f373e68ca1 tempest-VolumesGetTest-1746761850 None] Lock "cinder-f319b482-6075-4164-80ed-b42da7a920c1-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:15:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ca21e8bf-9050-465c-830d-f1edc55d23eb tempest-VolumesGetTest-1746761850 None] Acquiring lock "cinder-9ccf69ec-87c3-400e-ac6b-b118d4c1819b-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:15:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ca21e8bf-9050-465c-830d-f1edc55d23eb tempest-VolumesGetTest-1746761850 None] Lock "cinder-9ccf69ec-87c3-400e-ac6b-b118d4c1819b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:15:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ca21e8bf-9050-465c-830d-f1edc55d23eb tempest-VolumesGetTest-1746761850 None] Acquiring lock "cinder-quobyte-9ccf69ec-87c3-400e-ac6b-b118d4c1819b" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:15:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ca21e8bf-9050-465c-830d-f1edc55d23eb tempest-VolumesGetTest-1746761850 None] Lock "cinder-quobyte-9ccf69ec-87c3-400e-ac6b-b118d4c1819b" acquired by "delete_volume" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:15:21 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66c6f53-745f-43f8-a3a9-234d75877740]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:15:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ca21e8bf-9050-465c-830d-f1edc55d23eb tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ccf69ec-87c3-400e-ac6b-b118d4c1819b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:21 devstack sudo[103321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ccf69ec-87c3-400e-ac6b-b118d4c1819b
Sep 07 18:15:21 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:21 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ca21e8bf-9050-465c-830d-f1edc55d23eb tempest-VolumesGetTest-1746761850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ccf69ec-87c3-400e-ac6b-b118d4c1819b" returned: 0 in 0.349s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ca21e8bf-9050-465c-830d-f1edc55d23eb tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ccf69ec-87c3-400e-ac6b-b118d4c1819b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:21 devstack sudo[103326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ccf69ec-87c3-400e-ac6b-b118d4c1819b
Sep 07 18:15:21 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:22 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ca21e8bf-9050-465c-830d-f1edc55d23eb tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9ccf69ec-87c3-400e-ac6b-b118d4c1819b" returned: 0 in 0.238s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ca21e8bf-9050-465c-830d-f1edc55d23eb tempest-VolumesGetTest-1746761850 None] Lock "cinder-quobyte-9ccf69ec-87c3-400e-ac6b-b118d4c1819b" released by "delete_volume" :: held 0.627s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:15:22 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-ca21e8bf-9050-465c-830d-f1edc55d23eb tempest-VolumesGetTest-1746761850 None] Created reservations ['e78345c3-def1-41c2-9d2b-6d9eba34dfa3', '6be7d013-3e71-415c-948f-8a13aebd0bf6', '1f347709-425e-4804-9c7a-91d6512cfd09', 'd2b16183-5def-43c4-a5e2-1d483da0b605'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:15:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ca21e8bf-9050-465c-830d-f1edc55d23eb tempest-VolumesGetTest-1746761850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:15:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ca21e8bf-9050-465c-830d-f1edc55d23eb tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:15:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ca21e8bf-9050-465c-830d-f1edc55d23eb tempest-VolumesGetTest-1746761850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:15:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ca21e8bf-9050-465c-830d-f1edc55d23eb tempest-VolumesGetTest-1746761850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:15:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ca21e8bf-9050-465c-830d-f1edc55d23eb tempest-VolumesGetTest-1746761850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:15:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ca21e8bf-9050-465c-830d-f1edc55d23eb tempest-VolumesGetTest-1746761850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:22 devstack sudo[103329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:15:22 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:22 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ca21e8bf-9050-465c-830d-f1edc55d23eb tempest-VolumesGetTest-1746761850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.230s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:22 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-ca21e8bf-9050-465c-830d-f1edc55d23eb tempest-VolumesGetTest-1746761850 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:15:22 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ca21e8bf-9050-465c-830d-f1edc55d23eb tempest-VolumesGetTest-1746761850 None] Deleted volume successfully.
Sep 07 18:15:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ca21e8bf-9050-465c-830d-f1edc55d23eb tempest-VolumesGetTest-1746761850 None] Lock "cinder-9ccf69ec-87c3-400e-ac6b-b118d4c1819b-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:15:32 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=80,cinder:SELECT=61,cinder:INSERT=22,cinder:DELETE=8 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:15:32 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=55,cinder:INSERT=28,cinder:UPDATE=78,cinder:DELETE=6 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Flow 'volume_create_manager' (37c833a6-b88e-4013-9950-c7cf9d744da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db6b98df-547a-4dcd-84e4-7bae01812c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db6b98df-547a-4dcd-84e4-7bae01812c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-639476289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=334c3ee8-fee3-486d-a8db-d612958d3422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f0d39e141e943f3a2a69d92d45bd4bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:15:53Z,use_quota=True,user_id='ad513150472a48f0a97f2c3e8f0c4bda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3612936f-a9fb-4d2b-92da-4b3c4d1b45d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3612936f-a9fb-4d2b-92da-4b3c4d1b45d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f58c940-24ba-40ff-b288-6e7f4ccaee7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f58c940-24ba-40ff-b288-6e7f4ccaee7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '334c3ee8-fee3-486d-a8db-d612958d3422', 'volume_name': 'volume-334c3ee8-fee3-486d-a8db-d612958d3422', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e114f8-56bb-4885-a571-0e5f7725eea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e114f8-56bb-4885-a571-0e5f7725eea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1196ff6a-9012-40c3-92f6-b2f12b456cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:15:53 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Volume 334c3ee8-fee3-486d-a8db-d612958d3422: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-334c3ee8-fee3-486d-a8db-d612958d3422', 'volume_size': 1}
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:15:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-639476289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=334c3ee8-fee3-486d-a8db-d612958d3422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f0d39e141e943f3a2a69d92d45bd4bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:15:53Z,use_quota=True,user_id='ad513150472a48f0a97f2c3e8f0c4bda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Creating volume 334c3ee8-fee3-486d-a8db-d612958d3422 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:15:53 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-334c3ee8-fee3-486d-a8db-d612958d3422 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:53 devstack sudo[103460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-334c3ee8-fee3-486d-a8db-d612958d3422 1073741824
Sep 07 18:15:53 devstack sudo[103460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:53 devstack sudo[103460]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-334c3ee8-fee3-486d-a8db-d612958d3422 1073741824" returned: 0 in 0.431s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-334c3ee8-fee3-486d-a8db-d612958d3422 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:15:53 devstack sudo[103465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-334c3ee8-fee3-486d-a8db-d612958d3422
Sep 07 18:15:53 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:15:53 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-334c3ee8-fee3-486d-a8db-d612958d3422" returned: 0 in 0.248s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1196ff6a-9012-40c3-92f6-b2f12b456cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-334c3ee8-fee3-486d-a8db-d612958d3422', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:15:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da36d164-133a-4548-a005-006321cfa739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:15:54 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Volume volume-334c3ee8-fee3-486d-a8db-d612958d3422 (334c3ee8-fee3-486d-a8db-d612958d3422): created successfully
Sep 07 18:15:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da36d164-133a-4548-a005-006321cfa739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:15:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Flow 'volume_create_manager' (37c833a6-b88e-4013-9950-c7cf9d744da3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:15:54 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2ac5fdf8-8c77-410d-8a17-0db62fafb5fb tempest-TestMinimumBasicScenario-1728489930 None] Created volume successfully.
Sep 07 18:15:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-bb473238-bc7b-4111-a58e-e50e3603671b req-76635b2d-a63f-441d-ad2e-9abb6c47c188 tempest-TestMinimumBasicScenario-1728489930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:15:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-bb473238-bc7b-4111-a58e-e50e3603671b req-76635b2d-a63f-441d-ad2e-9abb6c47c188 tempest-TestMinimumBasicScenario-1728489930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:15:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-bb473238-bc7b-4111-a58e-e50e3603671b req-76635b2d-a63f-441d-ad2e-9abb6c47c188 tempest-TestMinimumBasicScenario-1728489930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:15:54 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-bb473238-bc7b-4111-a58e-e50e3603671b req-76635b2d-a63f-441d-ad2e-9abb6c47c188 tempest-TestMinimumBasicScenario-1728489930 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d', 'name': 'volume-334c3ee8-fee3-486d-a8db-d612958d3422', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '33d9004b-decb-4d51-bd2d-f5a128885b18', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 07 18:15:55 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-bb473238-bc7b-4111-a58e-e50e3603671b req-76635b2d-a63f-441d-ad2e-9abb6c47c188 tempest-TestMinimumBasicScenario-1728489930 None] attachment_update completed successfully.
Sep 07 18:16:00 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:16:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:16:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:16:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:16:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:16:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:16:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:16:00 devstack sudo[103865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:16:00 devstack sudo[103865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:16:01 devstack sudo[103865]: pam_unix(sudo:session): session closed for user root
Sep 07 18:16:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.295s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:16:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:16:01 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:16:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 07 18:16:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread info: [<_MainThread(MainThread, started 137533762306176)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137533650971072)>, <Thread(Thread-3 (stat_writer), started daemon 137533647226880)>, <Thread(Rabbit-heartbeat, started daemon 137533647437120)>, <Thread(Thread-5 (_runner), started daemon 137533648120896)>, <Thread(Thread-7 (_runner), started daemon 137533648182592)>, <Thread(fd_logger, started daemon 137533644336576)>, <Thread(privsep_reader, started daemon 137533643255424)>, <Thread(tpool_thread_0, started daemon 137533635446464)>, <Thread(tpool_thread_1, started daemon 137533627053760)>, <Thread(tpool_thread_2, started daemon 137533618661056)>, <Thread(tpool_thread_3, started daemon 137533610251968)>, <Thread(tpool_thread_4, started daemon 137533601842880)>, <Thread(tpool_thread_5, started daemon 137533593433792)>, <Thread(tpool_thread_6, started daemon 137533585024704)>, <Thread(tpool_thread_7, started daemon 137533576615616)>, <Thread(tpool_thread_8, started daemon 137533568206528)>, <Thread(tpool_thread_9, started daemon 137533559797440)>, <Thread(tpool_thread_10, started daemon 137533551388352)>, <Thread(tpool_thread_11, started daemon 137533542979264)>, <Thread(tpool_thread_12, started daemon 137533534570176)>, <Thread(tpool_thread_13, started daemon 137533526161088)>, <Thread(tpool_thread_14, started daemon 137533517752000)>, <Thread(tpool_thread_15, started daemon 137533509342912)>, <Thread(tpool_thread_16, started daemon 137533500933824)>, <Thread(tpool_thread_17, started daemon 137533492524736)>, <Thread(tpool_thread_18, started daemon 137533484115648)>, <Thread(tpool_thread_19, started daemon 137533475706560)>] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 07 18:16:05 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:16:05 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=5,cinder:SELECT=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:16:39 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-ef3aa70c-7254-4064-869b-fede87bb7158 req-30f3ab30-c5e2-4ab4-aa44-0ab48f299641 tempest-TestMinimumBasicScenario-1728489930 None] Terminate volume connection completed successfully.
Sep 07 18:16:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-ef3aa70c-7254-4064-869b-fede87bb7158 req-30f3ab30-c5e2-4ab4-aa44-0ab48f299641 tempest-TestMinimumBasicScenario-1728489930 None] Deleting attachment 33d9004b-decb-4d51-bd2d-f5a128885b18. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 07 18:16:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-041ae8dd-e73e-4883-893e-f473c246630d tempest-TestMinimumBasicScenario-1728489930 None] Acquiring lock "cinder-334c3ee8-fee3-486d-a8db-d612958d3422-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:16:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-041ae8dd-e73e-4883-893e-f473c246630d tempest-TestMinimumBasicScenario-1728489930 None] Lock "cinder-334c3ee8-fee3-486d-a8db-d612958d3422-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:16:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-041ae8dd-e73e-4883-893e-f473c246630d tempest-TestMinimumBasicScenario-1728489930 None] Acquiring lock "cinder-quobyte-334c3ee8-fee3-486d-a8db-d612958d3422" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:16:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-041ae8dd-e73e-4883-893e-f473c246630d tempest-TestMinimumBasicScenario-1728489930 None] Lock "cinder-quobyte-334c3ee8-fee3-486d-a8db-d612958d3422" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:16:40 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e501d60-81b8-4dfd-9437-8075a0de0ef3]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:16:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-041ae8dd-e73e-4883-893e-f473c246630d tempest-TestMinimumBasicScenario-1728489930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-334c3ee8-fee3-486d-a8db-d612958d3422 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:16:40 devstack sudo[104011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-334c3ee8-fee3-486d-a8db-d612958d3422
Sep 07 18:16:40 devstack sudo[104011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:16:40 devstack sudo[104011]: pam_unix(sudo:session): session closed for user root
Sep 07 18:16:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-041ae8dd-e73e-4883-893e-f473c246630d tempest-TestMinimumBasicScenario-1728489930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-334c3ee8-fee3-486d-a8db-d612958d3422" returned: 0 in 0.351s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:16:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-041ae8dd-e73e-4883-893e-f473c246630d tempest-TestMinimumBasicScenario-1728489930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-334c3ee8-fee3-486d-a8db-d612958d3422 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:16:41 devstack sudo[104016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-334c3ee8-fee3-486d-a8db-d612958d3422
Sep 07 18:16:41 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:16:41 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root
Sep 07 18:16:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-041ae8dd-e73e-4883-893e-f473c246630d tempest-TestMinimumBasicScenario-1728489930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-334c3ee8-fee3-486d-a8db-d612958d3422" returned: 0 in 0.244s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:16:41 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-041ae8dd-e73e-4883-893e-f473c246630d tempest-TestMinimumBasicScenario-1728489930 None] Lock "cinder-quobyte-334c3ee8-fee3-486d-a8db-d612958d3422" released by "delete_volume" :: held 0.632s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:16:41 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-041ae8dd-e73e-4883-893e-f473c246630d tempest-TestMinimumBasicScenario-1728489930 None] Created reservations ['e9d37aac-f385-4fb5-bf6a-307bbd496b25', 'c528df32-d641-48cc-903e-fbd31bb5e6c0', '64dd9856-8a96-4af1-9738-1be222313f06', '35429398-679d-4216-9928-702fb0b6a3dc'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:16:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-041ae8dd-e73e-4883-893e-f473c246630d tempest-TestMinimumBasicScenario-1728489930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:16:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-041ae8dd-e73e-4883-893e-f473c246630d tempest-TestMinimumBasicScenario-1728489930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:16:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-041ae8dd-e73e-4883-893e-f473c246630d tempest-TestMinimumBasicScenario-1728489930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:16:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-041ae8dd-e73e-4883-893e-f473c246630d tempest-TestMinimumBasicScenario-1728489930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:16:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-041ae8dd-e73e-4883-893e-f473c246630d tempest-TestMinimumBasicScenario-1728489930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:16:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-041ae8dd-e73e-4883-893e-f473c246630d tempest-TestMinimumBasicScenario-1728489930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:16:41 devstack sudo[104019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:16:41 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:16:41 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root
Sep 07 18:16:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-041ae8dd-e73e-4883-893e-f473c246630d tempest-TestMinimumBasicScenario-1728489930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.249s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:16:41 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-041ae8dd-e73e-4883-893e-f473c246630d tempest-TestMinimumBasicScenario-1728489930 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:16:41 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-041ae8dd-e73e-4883-893e-f473c246630d tempest-TestMinimumBasicScenario-1728489930 None] Deleted volume successfully.
Sep 07 18:16:41 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-041ae8dd-e73e-4883-893e-f473c246630d tempest-TestMinimumBasicScenario-1728489930 None] Lock "cinder-334c3ee8-fee3-486d-a8db-d612958d3422-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:16:51 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=8,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:16:51 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:17:00 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:17:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:17:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:17:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:17:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:17:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:17:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:17:00 devstack sudo[104053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:17:00 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:17:01 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root
Sep 07 18:17:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.259s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:17:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:17:01 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:17:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 07 18:17:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread info: [<_MainThread(MainThread, started 137533762306176)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137533650971072)>, <Thread(Thread-3 (stat_writer), started daemon 137533647226880)>, <Thread(Rabbit-heartbeat, started daemon 137533647437120)>, <Thread(Thread-5 (_runner), started daemon 137533648120896)>, <Thread(Thread-7 (_runner), started daemon 137533648182592)>, <Thread(fd_logger, started daemon 137533644336576)>, <Thread(privsep_reader, started daemon 137533643255424)>, <Thread(tpool_thread_0, started daemon 137533635446464)>, <Thread(tpool_thread_1, started daemon 137533627053760)>, <Thread(tpool_thread_2, started daemon 137533618661056)>, <Thread(tpool_thread_3, started daemon 137533610251968)>, <Thread(tpool_thread_4, started daemon 137533601842880)>, <Thread(tpool_thread_5, started daemon 137533593433792)>, <Thread(tpool_thread_6, started daemon 137533585024704)>, <Thread(tpool_thread_7, started daemon 137533576615616)>, <Thread(tpool_thread_8, started daemon 137533568206528)>, <Thread(tpool_thread_9, started daemon 137533559797440)>, <Thread(tpool_thread_10, started daemon 137533551388352)>, <Thread(tpool_thread_11, started daemon 137533542979264)>, <Thread(tpool_thread_12, started daemon 137533534570176)>, <Thread(tpool_thread_13, started daemon 137533526161088)>, <Thread(tpool_thread_14, started daemon 137533517752000)>, <Thread(tpool_thread_15, started daemon 137533509342912)>, <Thread(tpool_thread_16, started daemon 137533500933824)>, <Thread(tpool_thread_17, started daemon 137533492524736)>, <Thread(tpool_thread_18, started daemon 137533484115648)>, <Thread(tpool_thread_19, started daemon 137533475706560)>] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Flow 'volume_create_manager' (6613ab68-ec68-419e-a177-50983abf4e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90308e57-d873-4fd5-9193-ade53c769920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90308e57-d873-4fd5-9193-ade53c769920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-974328257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf20a8d-eb1e-4e1a-919a-348e7b688677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5d9228392a4722a129c2e8262d752b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:17:13Z,use_quota=True,user_id='a40741a32eb2414d80eba8074876ab04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (024799d7-7089-4425-bd26-7862102e6897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (024799d7-7089-4425-bd26-7862102e6897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ab42c1-4b84-437e-9e5b-f14a8e54b708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ab42c1-4b84-437e-9e5b-f14a8e54b708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bf20a8d-eb1e-4e1a-919a-348e7b688677', 'volume_name': 'volume-3bf20a8d-eb1e-4e1a-919a-348e7b688677', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd3b3a10-a999-49fe-bf01-c478d7470c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd3b3a10-a999-49fe-bf01-c478d7470c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47701cf3-12c2-443b-a601-5ed196cac7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:17:13 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Volume 3bf20a8d-eb1e-4e1a-919a-348e7b688677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bf20a8d-eb1e-4e1a-919a-348e7b688677', 'volume_size': 1}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-974328257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf20a8d-eb1e-4e1a-919a-348e7b688677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5d9228392a4722a129c2e8262d752b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:17:13Z,use_quota=True,user_id='a40741a32eb2414d80eba8074876ab04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Creating volume 3bf20a8d-eb1e-4e1a-919a-348e7b688677 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:17:13 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3bf20a8d-eb1e-4e1a-919a-348e7b688677 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:17:13 devstack sudo[104097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3bf20a8d-eb1e-4e1a-919a-348e7b688677 1073741824
Sep 07 18:17:13 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Flow 'volume_create_manager' (35356ce7-c65b-430d-b27a-a69bd670f34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05bf8103-0b5e-4bd2-b929-bd1bb51331c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05bf8103-0b5e-4bd2-b929-bd1bb51331c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1344703958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88b2a560-dde1-4c58-838b-4cad20a4b6a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5d9228392a4722a129c2e8262d752b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:17:14Z,use_quota=True,user_id='a40741a32eb2414d80eba8074876ab04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9227d84-2de3-4ea7-b7a4-4aa976a0a91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9227d84-2de3-4ea7-b7a4-4aa976a0a91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e592db3-6a33-46ef-8a21-5eb682be0e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e592db3-6a33-46ef-8a21-5eb682be0e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88b2a560-dde1-4c58-838b-4cad20a4b6a2', 'volume_name': 'volume-88b2a560-dde1-4c58-838b-4cad20a4b6a2', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeebeabd-e275-45d7-8f0f-95cc3163a664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeebeabd-e275-45d7-8f0f-95cc3163a664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2205354f-9267-480b-bc6f-6b89615693c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:17:13 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Volume 88b2a560-dde1-4c58-838b-4cad20a4b6a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88b2a560-dde1-4c58-838b-4cad20a4b6a2', 'volume_size': 1}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:17:13 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3bf20a8d-eb1e-4e1a-919a-348e7b688677 1073741824" returned: 0 in 0.491s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:17:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3bf20a8d-eb1e-4e1a-919a-348e7b688677 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:17:13 devstack sudo[104103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3bf20a8d-eb1e-4e1a-919a-348e7b688677
Sep 07 18:17:13 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:17:14 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root
Sep 07 18:17:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3bf20a8d-eb1e-4e1a-919a-348e7b688677" returned: 0 in 0.270s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:17:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:17:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:17:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.452s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:17:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1344703958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88b2a560-dde1-4c58-838b-4cad20a4b6a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5d9228392a4722a129c2e8262d752b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:17:14Z,use_quota=True,user_id='a40741a32eb2414d80eba8074876ab04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:17:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Creating volume 88b2a560-dde1-4c58-838b-4cad20a4b6a2 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:17:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:17:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:17:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:17:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:17:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:17:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:17:14 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:17:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-88b2a560-dde1-4c58-838b-4cad20a4b6a2 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:17:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47701cf3-12c2-443b-a601-5ed196cac7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bf20a8d-eb1e-4e1a-919a-348e7b688677', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:17:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019bd28b-7d6a-411e-a86f-812dd8355765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:17:14 devstack sudo[104106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-88b2a560-dde1-4c58-838b-4cad20a4b6a2 1073741824
Sep 07 18:17:14 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:17:14 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Volume volume-3bf20a8d-eb1e-4e1a-919a-348e7b688677 (3bf20a8d-eb1e-4e1a-919a-348e7b688677): created successfully
Sep 07 18:17:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (019bd28b-7d6a-411e-a86f-812dd8355765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:17:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Flow 'volume_create_manager' (6613ab68-ec68-419e-a177-50983abf4e84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:17:14 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-8a2496f3-63b2-4c84-9a35-71ca035a5467 tempest-TestServerVolumeAttachmentScenario-410821928 None] Created volume successfully.
Sep 07 18:17:14 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root
Sep 07 18:17:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-88b2a560-dde1-4c58-838b-4cad20a4b6a2 1073741824" returned: 0 in 0.461s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:17:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-88b2a560-dde1-4c58-838b-4cad20a4b6a2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:17:14 devstack sudo[104113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-88b2a560-dde1-4c58-838b-4cad20a4b6a2
Sep 07 18:17:14 devstack sudo[104113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:17:14 devstack sudo[104113]: pam_unix(sudo:session): session closed for user root
Sep 07 18:17:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-88b2a560-dde1-4c58-838b-4cad20a4b6a2" returned: 0 in 0.247s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:17:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:17:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:17:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2205354f-9267-480b-bc6f-6b89615693c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88b2a560-dde1-4c58-838b-4cad20a4b6a2', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:17:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd85a21-9947-4dae-ab64-4bbac6b288aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:17:14 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Volume volume-88b2a560-dde1-4c58-838b-4cad20a4b6a2 (88b2a560-dde1-4c58-838b-4cad20a4b6a2): created successfully
Sep 07 18:17:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd85a21-9947-4dae-ab64-4bbac6b288aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:17:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Flow 'volume_create_manager' (35356ce7-c65b-430d-b27a-a69bd670f34c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:17:14 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-470ab454-c5ec-4ceb-ad56-de8fe6788658 tempest-TestServerVolumeAttachmentScenario-410821928 None] Created volume successfully.
Sep 07 18:17:24 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=7,cinder:SELECT=1 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:17:24 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=5,cinder:DELETE=2 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:17:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-7ff293ca-7738-4a0a-b6e9-451b2449cefc req-f1fd6f22-7323-442f-b66f-bb9cdbe8a2c7 tempest-TestServerVolumeAttachmentScenario-410821928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:17:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-7ff293ca-7738-4a0a-b6e9-451b2449cefc req-f1fd6f22-7323-442f-b66f-bb9cdbe8a2c7 tempest-TestServerVolumeAttachmentScenario-410821928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:17:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-7ff293ca-7738-4a0a-b6e9-451b2449cefc req-f1fd6f22-7323-442f-b66f-bb9cdbe8a2c7 tempest-TestServerVolumeAttachmentScenario-410821928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:17:44 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-7ff293ca-7738-4a0a-b6e9-451b2449cefc req-f1fd6f22-7323-442f-b66f-bb9cdbe8a2c7 tempest-TestServerVolumeAttachmentScenario-410821928 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d', 'name': 'volume-3bf20a8d-eb1e-4e1a-919a-348e7b688677', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1806096d-06ce-4cbb-80fa-bc508500ed09', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 07 18:17:44 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-7ff293ca-7738-4a0a-b6e9-451b2449cefc req-f1fd6f22-7323-442f-b66f-bb9cdbe8a2c7 tempest-TestServerVolumeAttachmentScenario-410821928 None] attachment_update completed successfully.
Sep 07 18:17:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-c3623027-fdfc-4d7a-ab7a-e844edc7afc3 req-536623fc-268c-4e86-ba55-ae455eef6069 tempest-TestServerVolumeAttachmentScenario-410821928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:17:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-c3623027-fdfc-4d7a-ab7a-e844edc7afc3 req-536623fc-268c-4e86-ba55-ae455eef6069 tempest-TestServerVolumeAttachmentScenario-410821928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:17:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [req-c3623027-fdfc-4d7a-ab7a-e844edc7afc3 req-536623fc-268c-4e86-ba55-ae455eef6069 tempest-TestServerVolumeAttachmentScenario-410821928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:17:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-c3623027-fdfc-4d7a-ab7a-e844edc7afc3 req-536623fc-268c-4e86-ba55-ae455eef6069 tempest-TestServerVolumeAttachmentScenario-410821928 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d', 'name': 'volume-88b2a560-dde1-4c58-838b-4cad20a4b6a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc2823f2-5a02-4ccf-a849-5542d8f99834', 'enforce_multipath': True} {{(pid=87269) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 07 18:17:47 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-c3623027-fdfc-4d7a-ab7a-e844edc7afc3 req-536623fc-268c-4e86-ba55-ae455eef6069 tempest-TestServerVolumeAttachmentScenario-410821928 None] attachment_update completed successfully.
Sep 07 18:17:49 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-a710b86f-890a-4dd8-99b2-b0c5cf942071 req-3525cc22-7c6e-46a8-81f3-279c8c958cc4 tempest-TestServerVolumeAttachmentScenario-410821928 None] Terminate volume connection completed successfully.
Sep 07 18:17:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-a710b86f-890a-4dd8-99b2-b0c5cf942071 req-3525cc22-7c6e-46a8-81f3-279c8c958cc4 tempest-TestServerVolumeAttachmentScenario-410821928 None] Deleting attachment cc2823f2-5a02-4ccf-a849-5542d8f99834. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 07 18:17:50 devstack cinder-volume[87269]: INFO cinder.volume.manager [req-4f74f782-0936-402b-85cc-730ea6085847 req-7aef0bf3-239e-479b-a4ae-86fe58c78bdc tempest-TestServerVolumeAttachmentScenario-410821928 None] Terminate volume connection completed successfully.
Sep 07 18:17:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [req-4f74f782-0936-402b-85cc-730ea6085847 req-7aef0bf3-239e-479b-a4ae-86fe58c78bdc tempest-TestServerVolumeAttachmentScenario-410821928 None] Deleting attachment 1806096d-06ce-4cbb-80fa-bc508500ed09. {{(pid=87269) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 07 18:17:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0089173e-941d-44c2-8c92-dc0758da81b1 tempest-TestServerVolumeAttachmentScenario-410821928 None] Acquiring lock "cinder-88b2a560-dde1-4c58-838b-4cad20a4b6a2-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:17:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0089173e-941d-44c2-8c92-dc0758da81b1 tempest-TestServerVolumeAttachmentScenario-410821928 None] Lock "cinder-88b2a560-dde1-4c58-838b-4cad20a4b6a2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:17:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0089173e-941d-44c2-8c92-dc0758da81b1 tempest-TestServerVolumeAttachmentScenario-410821928 None] Acquiring lock "cinder-quobyte-88b2a560-dde1-4c58-838b-4cad20a4b6a2" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:17:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0089173e-941d-44c2-8c92-dc0758da81b1 tempest-TestServerVolumeAttachmentScenario-410821928 None] Lock "cinder-quobyte-88b2a560-dde1-4c58-838b-4cad20a4b6a2" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:17:55 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e350bde8-4332-48a9-bee2-e8e3e2124811]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:17:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0089173e-941d-44c2-8c92-dc0758da81b1 tempest-TestServerVolumeAttachmentScenario-410821928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-88b2a560-dde1-4c58-838b-4cad20a4b6a2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:17:55 devstack sudo[104695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-88b2a560-dde1-4c58-838b-4cad20a4b6a2
Sep 07 18:17:55 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:17:55 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root
Sep 07 18:17:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0089173e-941d-44c2-8c92-dc0758da81b1 tempest-TestServerVolumeAttachmentScenario-410821928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-88b2a560-dde1-4c58-838b-4cad20a4b6a2" returned: 0 in 0.346s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:17:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0089173e-941d-44c2-8c92-dc0758da81b1 tempest-TestServerVolumeAttachmentScenario-410821928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-88b2a560-dde1-4c58-838b-4cad20a4b6a2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:17:55 devstack sudo[104700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-88b2a560-dde1-4c58-838b-4cad20a4b6a2
Sep 07 18:17:55 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:17:55 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root
Sep 07 18:17:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0089173e-941d-44c2-8c92-dc0758da81b1 tempest-TestServerVolumeAttachmentScenario-410821928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-88b2a560-dde1-4c58-838b-4cad20a4b6a2" returned: 0 in 0.244s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:17:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0089173e-941d-44c2-8c92-dc0758da81b1 tempest-TestServerVolumeAttachmentScenario-410821928 None] Lock "cinder-quobyte-88b2a560-dde1-4c58-838b-4cad20a4b6a2" released by "delete_volume" :: held 0.626s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:17:55 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-0089173e-941d-44c2-8c92-dc0758da81b1 tempest-TestServerVolumeAttachmentScenario-410821928 None] Created reservations ['0cf21164-9574-44f5-90ef-6662de3cac54', 'e2df943e-e0d0-4457-91ba-02ca1696f41f', 'a3ac3f12-4002-4c54-9ca2-1dbc6ab685e2', '04a7aa61-fe15-4c75-85f5-346084a78f42'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:17:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0089173e-941d-44c2-8c92-dc0758da81b1 tempest-TestServerVolumeAttachmentScenario-410821928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:17:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0089173e-941d-44c2-8c92-dc0758da81b1 tempest-TestServerVolumeAttachmentScenario-410821928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:17:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0089173e-941d-44c2-8c92-dc0758da81b1 tempest-TestServerVolumeAttachmentScenario-410821928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:17:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0089173e-941d-44c2-8c92-dc0758da81b1 tempest-TestServerVolumeAttachmentScenario-410821928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:17:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0089173e-941d-44c2-8c92-dc0758da81b1 tempest-TestServerVolumeAttachmentScenario-410821928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:17:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0089173e-941d-44c2-8c92-dc0758da81b1 tempest-TestServerVolumeAttachmentScenario-410821928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:17:55 devstack sudo[104703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:17:55 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:17:56 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root
Sep 07 18:17:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0089173e-941d-44c2-8c92-dc0758da81b1 tempest-TestServerVolumeAttachmentScenario-410821928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.248s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:17:56 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-0089173e-941d-44c2-8c92-dc0758da81b1 tempest-TestServerVolumeAttachmentScenario-410821928 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:17:56 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0089173e-941d-44c2-8c92-dc0758da81b1 tempest-TestServerVolumeAttachmentScenario-410821928 None] Deleted volume successfully.
Sep 07 18:17:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0089173e-941d-44c2-8c92-dc0758da81b1 tempest-TestServerVolumeAttachmentScenario-410821928 None] Lock "cinder-88b2a560-dde1-4c58-838b-4cad20a4b6a2-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:17:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-45242958-de5a-4385-84fc-dcaad644fbeb tempest-TestServerVolumeAttachmentScenario-410821928 None] Acquiring lock "cinder-3bf20a8d-eb1e-4e1a-919a-348e7b688677-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:17:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-45242958-de5a-4385-84fc-dcaad644fbeb tempest-TestServerVolumeAttachmentScenario-410821928 None] Lock "cinder-3bf20a8d-eb1e-4e1a-919a-348e7b688677-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:17:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-45242958-de5a-4385-84fc-dcaad644fbeb tempest-TestServerVolumeAttachmentScenario-410821928 None] Acquiring lock "cinder-quobyte-3bf20a8d-eb1e-4e1a-919a-348e7b688677" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:17:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-45242958-de5a-4385-84fc-dcaad644fbeb tempest-TestServerVolumeAttachmentScenario-410821928 None] Lock "cinder-quobyte-3bf20a8d-eb1e-4e1a-919a-348e7b688677" acquired by "delete_volume" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:17:56 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dba397f-ac3d-467c-a94e-570ca9583292]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:17:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45242958-de5a-4385-84fc-dcaad644fbeb tempest-TestServerVolumeAttachmentScenario-410821928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3bf20a8d-eb1e-4e1a-919a-348e7b688677 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:17:56 devstack sudo[104708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3bf20a8d-eb1e-4e1a-919a-348e7b688677
Sep 07 18:17:56 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:17:56 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root
Sep 07 18:17:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45242958-de5a-4385-84fc-dcaad644fbeb tempest-TestServerVolumeAttachmentScenario-410821928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3bf20a8d-eb1e-4e1a-919a-348e7b688677" returned: 0 in 0.358s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:17:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45242958-de5a-4385-84fc-dcaad644fbeb tempest-TestServerVolumeAttachmentScenario-410821928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3bf20a8d-eb1e-4e1a-919a-348e7b688677 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:17:56 devstack sudo[104714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3bf20a8d-eb1e-4e1a-919a-348e7b688677
Sep 07 18:17:56 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:17:56 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root
Sep 07 18:17:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45242958-de5a-4385-84fc-dcaad644fbeb tempest-TestServerVolumeAttachmentScenario-410821928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3bf20a8d-eb1e-4e1a-919a-348e7b688677" returned: 0 in 0.246s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:17:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-45242958-de5a-4385-84fc-dcaad644fbeb tempest-TestServerVolumeAttachmentScenario-410821928 None] Lock "cinder-quobyte-3bf20a8d-eb1e-4e1a-919a-348e7b688677" released by "delete_volume" :: held 0.651s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:17:57 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-45242958-de5a-4385-84fc-dcaad644fbeb tempest-TestServerVolumeAttachmentScenario-410821928 None] Created reservations ['0eaa4e1c-e2f6-48f9-ba63-a9b5d1b902b8', '3536317b-cad0-4f3a-ab53-22448b53f495', 'a91c9d5e-8ab3-4ddf-9079-2334fed32b93', '5bae4134-2ee0-4bfe-b510-33b14414f9dd'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:17:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-45242958-de5a-4385-84fc-dcaad644fbeb tempest-TestServerVolumeAttachmentScenario-410821928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:17:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-45242958-de5a-4385-84fc-dcaad644fbeb tempest-TestServerVolumeAttachmentScenario-410821928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:17:57 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-45242958-de5a-4385-84fc-dcaad644fbeb tempest-TestServerVolumeAttachmentScenario-410821928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:17:57 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-45242958-de5a-4385-84fc-dcaad644fbeb tempest-TestServerVolumeAttachmentScenario-410821928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:17:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-45242958-de5a-4385-84fc-dcaad644fbeb tempest-TestServerVolumeAttachmentScenario-410821928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:17:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45242958-de5a-4385-84fc-dcaad644fbeb tempest-TestServerVolumeAttachmentScenario-410821928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:17:57 devstack sudo[104717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:17:57 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:17:57 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root
Sep 07 18:17:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45242958-de5a-4385-84fc-dcaad644fbeb tempest-TestServerVolumeAttachmentScenario-410821928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.248s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:17:57 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-45242958-de5a-4385-84fc-dcaad644fbeb tempest-TestServerVolumeAttachmentScenario-410821928 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:17:57 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-45242958-de5a-4385-84fc-dcaad644fbeb tempest-TestServerVolumeAttachmentScenario-410821928 None] Deleted volume successfully.
Sep 07 18:17:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-45242958-de5a-4385-84fc-dcaad644fbeb tempest-TestServerVolumeAttachmentScenario-410821928 None] Lock "cinder-3bf20a8d-eb1e-4e1a-919a-348e7b688677-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:18:00 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:18:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:18:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:18:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:18:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:18:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:18:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:18:00 devstack sudo[104721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:18:00 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:18:01 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root
Sep 07 18:18:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.267s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:18:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:18:01 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:18:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 07 18:18:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread info: [<_MainThread(MainThread, started 137533762306176)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137533650971072)>, <Thread(Thread-3 (stat_writer), started daemon 137533647226880)>, <Thread(Rabbit-heartbeat, started daemon 137533647437120)>, <Thread(Thread-5 (_runner), started daemon 137533648120896)>, <Thread(Thread-7 (_runner), started daemon 137533648182592)>, <Thread(fd_logger, started daemon 137533644336576)>, <Thread(privsep_reader, started daemon 137533643255424)>, <Thread(tpool_thread_0, started daemon 137533635446464)>, <Thread(tpool_thread_1, started daemon 137533627053760)>, <Thread(tpool_thread_2, started daemon 137533618661056)>, <Thread(tpool_thread_3, started daemon 137533610251968)>, <Thread(tpool_thread_4, started daemon 137533601842880)>, <Thread(tpool_thread_5, started daemon 137533593433792)>, <Thread(tpool_thread_6, started daemon 137533585024704)>, <Thread(tpool_thread_7, started daemon 137533576615616)>, <Thread(tpool_thread_8, started daemon 137533568206528)>, <Thread(tpool_thread_9, started daemon 137533559797440)>, <Thread(tpool_thread_10, started daemon 137533551388352)>, <Thread(tpool_thread_11, started daemon 137533542979264)>, <Thread(tpool_thread_12, started daemon 137533534570176)>, <Thread(tpool_thread_13, started daemon 137533526161088)>, <Thread(tpool_thread_14, started daemon 137533517752000)>, <Thread(tpool_thread_15, started daemon 137533509342912)>, <Thread(tpool_thread_16, started daemon 137533500933824)>, <Thread(tpool_thread_17, started daemon 137533492524736)>, <Thread(tpool_thread_18, started daemon 137533484115648)>, <Thread(tpool_thread_19, started daemon 137533475706560)>] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 07 18:18:07 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=22,cinder:UPDATE=18,cinder:INSERT=3 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:18:07 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=28,cinder:UPDATE=20,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:18:25 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:18:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Flow 'volume_create_manager' (e757a34c-0eff-4ee4-a1eb-faef26991a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:18:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc9bb945-9848-444d-8c1b-43174a42c84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:18:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc9bb945-9848-444d-8c1b-43174a42c84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-827515162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602cc49d-24be-4b69-8469-6f87dcd778c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede55dc43e8643878c22af7972a1d026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:18:25Z,use_quota=True,user_id='0ad3f32a486849659f562401ea2a1917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:18:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c933ae79-09e3-47c9-bbd8-40bb8942f5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:18:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c933ae79-09e3-47c9-bbd8-40bb8942f5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:18:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f734ae1-d1ac-4c63-8f72-e2d380ec1756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:18:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f734ae1-d1ac-4c63-8f72-e2d380ec1756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '602cc49d-24be-4b69-8469-6f87dcd778c1', 'volume_name': 'volume-602cc49d-24be-4b69-8469-6f87dcd778c1', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:18:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8677daf5-7712-41ed-b2de-0ce5b469531b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:18:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8677daf5-7712-41ed-b2de-0ce5b469531b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:18:25 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2118887d-b23d-4158-9a5f-6b5c47fe6774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:18:25 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Volume 602cc49d-24be-4b69-8469-6f87dcd778c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-602cc49d-24be-4b69-8469-6f87dcd778c1', 'volume_size': 1}
Sep 07 18:18:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:18:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:18:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-827515162',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=602cc49d-24be-4b69-8469-6f87dcd778c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede55dc43e8643878c22af7972a1d026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:18:25Z,use_quota=True,user_id='0ad3f32a486849659f562401ea2a1917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:18:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Creating volume 602cc49d-24be-4b69-8469-6f87dcd778c1 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:18:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:18:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:18:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:18:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:18:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:18:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:18:25 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:18:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:18:25 devstack sudo[104771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1 1073741824
Sep 07 18:18:25 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:18:25 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root
Sep 07 18:18:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1 1073741824" returned: 0 in 0.401s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:18:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:18:25 devstack sudo[104777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1
Sep 07 18:18:25 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:18:26 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root
Sep 07 18:18:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1" returned: 0 in 0.238s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:18:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:18:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:18:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2118887d-b23d-4158-9a5f-6b5c47fe6774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-602cc49d-24be-4b69-8469-6f87dcd778c1', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:18:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e720cf5a-0b72-410a-b2eb-ae8a42060d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:18:26 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Volume volume-602cc49d-24be-4b69-8469-6f87dcd778c1 (602cc49d-24be-4b69-8469-6f87dcd778c1): created successfully
Sep 07 18:18:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e720cf5a-0b72-410a-b2eb-ae8a42060d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:18:26 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Flow 'volume_create_manager' (e757a34c-0eff-4ee4-a1eb-faef26991a2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:18:26 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a655d683-138d-4e3b-9488-b4d63fa58bf1 tempest-SnapshotDependencyTests-1811703137 None] Created volume successfully.
Sep 07 18:18:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d236268d-2b92-4e5f-bafb-db42126ac6fc tempest-SnapshotDependencyTests-1811703137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:18:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d236268d-2b92-4e5f-bafb-db42126ac6fc tempest-SnapshotDependencyTests-1811703137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:18:26 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d236268d-2b92-4e5f-bafb-db42126ac6fc tempest-SnapshotDependencyTests-1811703137 None] Creating offline snapshot 293afa29-057b-4579-9714-0e376f7e26ad of volume 602cc49d-24be-4b69-8469-6f87dcd778c1 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:18:26 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b254d245-98db-43ba-8a89-e416895d2396]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:18:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d236268d-2b92-4e5f-bafb-db42126ac6fc tempest-SnapshotDependencyTests-1811703137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:18:26 devstack sudo[104781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1
Sep 07 18:18:26 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:18:26 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root
Sep 07 18:18:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d236268d-2b92-4e5f-bafb-db42126ac6fc tempest-SnapshotDependencyTests-1811703137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1" returned: 0 in 0.345s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:18:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d236268d-2b92-4e5f-bafb-db42126ac6fc tempest-SnapshotDependencyTests-1811703137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.293afa29-057b-4579-9714-0e376f7e26ad 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:18:26 devstack sudo[104786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.293afa29-057b-4579-9714-0e376f7e26ad 1G
Sep 07 18:18:26 devstack sudo[104786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:18:27 devstack sudo[104786]: pam_unix(sudo:session): session closed for user root
Sep 07 18:18:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d236268d-2b92-4e5f-bafb-db42126ac6fc tempest-SnapshotDependencyTests-1811703137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.293afa29-057b-4579-9714-0e376f7e26ad 1G" returned: 0 in 0.382s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:18:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d236268d-2b92-4e5f-bafb-db42126ac6fc tempest-SnapshotDependencyTests-1811703137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-602cc49d-24be-4b69-8469-6f87dcd778c1 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.293afa29-057b-4579-9714-0e376f7e26ad {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:18:27 devstack sudo[104791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-602cc49d-24be-4b69-8469-6f87dcd778c1 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.293afa29-057b-4579-9714-0e376f7e26ad
Sep 07 18:18:27 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:18:27 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root
Sep 07 18:18:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d236268d-2b92-4e5f-bafb-db42126ac6fc tempest-SnapshotDependencyTests-1811703137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-602cc49d-24be-4b69-8469-6f87dcd778c1 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.293afa29-057b-4579-9714-0e376f7e26ad" returned: 0 in 0.280s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:18:27 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-d236268d-2b92-4e5f-bafb-db42126ac6fc tempest-SnapshotDependencyTests-1811703137 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.293afa29-057b-4579-9714-0e376f7e26ad is being set with open permissions: ugo+rw
Sep 07 18:18:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d236268d-2b92-4e5f-bafb-db42126ac6fc tempest-SnapshotDependencyTests-1811703137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.293afa29-057b-4579-9714-0e376f7e26ad {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:18:27 devstack sudo[104796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.293afa29-057b-4579-9714-0e376f7e26ad
Sep 07 18:18:27 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:18:27 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root
Sep 07 18:18:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d236268d-2b92-4e5f-bafb-db42126ac6fc tempest-SnapshotDependencyTests-1811703137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.293afa29-057b-4579-9714-0e376f7e26ad" returned: 0 in 0.241s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:18:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d236268d-2b92-4e5f-bafb-db42126ac6fc tempest-SnapshotDependencyTests-1811703137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:18:27 devstack sudo[104799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.info
Sep 07 18:18:27 devstack sudo[104799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:18:28 devstack sudo[104799]: pam_unix(sudo:session): session closed for user root
Sep 07 18:18:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d236268d-2b92-4e5f-bafb-db42126ac6fc tempest-SnapshotDependencyTests-1811703137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.info" returned: 0 in 0.244s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:18:28 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-d236268d-2b92-4e5f-bafb-db42126ac6fc tempest-SnapshotDependencyTests-1811703137 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.info is being set with open permissions: ugo+rw
Sep 07 18:18:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d236268d-2b92-4e5f-bafb-db42126ac6fc tempest-SnapshotDependencyTests-1811703137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:18:28 devstack sudo[104802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.info
Sep 07 18:18:28 devstack sudo[104802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:18:28 devstack sudo[104802]: pam_unix(sudo:session): session closed for user root
Sep 07 18:18:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d236268d-2b92-4e5f-bafb-db42126ac6fc tempest-SnapshotDependencyTests-1811703137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.info" returned: 0 in 0.241s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:18:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d236268d-2b92-4e5f-bafb-db42126ac6fc tempest-SnapshotDependencyTests-1811703137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.810s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:18:28 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d236268d-2b92-4e5f-bafb-db42126ac6fc tempest-SnapshotDependencyTests-1811703137 None] Create snapshot completed successfully
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Flow 'volume_create_manager' (77446e83-473a-4f65-9f4c-b5b77bcdc6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92ff723-0916-407b-8a70-ee6fff497e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a92ff723-0916-407b-8a70-ee6fff497e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a20f363-88c1-4b16-9b06-d75447a82383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ede55dc43e8643878c22af7972a1d026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=293afa29-057b-4579-9714-0e376f7e26ad,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:18:29Z,use_quota=True,user_id='0ad3f32a486849659f562401ea2a1917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2d0d4f-032f-4cd1-a122-20083550c791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2d0d4f-032f-4cd1-a122-20083550c791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ba771a-fc09-4873-8686-25ff701d0d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89ba771a-fc09-4873-8686-25ff701d0d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8a20f363-88c1-4b16-9b06-d75447a82383', 'volume_name': 'volume-8a20f363-88c1-4b16-9b06-d75447a82383', 'volume_size': 1, 'snapshot_id': '293afa29-057b-4579-9714-0e376f7e26ad'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6401783-7907-4ca2-9e68-43df735b657d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6401783-7907-4ca2-9e68-43df735b657d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f72507e-ee12-4568-83ec-ccf1caff47fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:18:29 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Volume 8a20f363-88c1-4b16-9b06-d75447a82383: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8a20f363-88c1-4b16-9b06-d75447a82383', 'volume_size': 1, 'snapshot_id': '293afa29-057b-4579-9714-0e376f7e26ad'}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Acquiring lock "cinder-quobyte-293afa29-057b-4579-9714-0e376f7e26ad-8a20f363-88c1-4b16-9b06-d75447a82383" by "_create_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Lock "cinder-quobyte-293afa29-057b-4579-9714-0e376f7e26ad-8a20f363-88c1-4b16-9b06-d75447a82383" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Creating volume 8a20f363-88c1-4b16-9b06-d75447a82383 from snapshot 293afa29-057b-4579-9714-0e376f7e26ad {{(pid=87269) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Acquiring lock "cinder-quobyte-8a20f363-88c1-4b16-9b06-d75447a82383" by "_copy_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Lock "cinder-quobyte-8a20f363-88c1-4b16-9b06-d75447a82383" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] snapshot: 293afa29-057b-4579-9714-0e376f7e26ad, volume: 8a20f363-88c1-4b16-9b06-d75447a82383,  {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2cbf90-f181-4afe-a6f1-995ed612cc18]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.293afa29-057b-4579-9714-0e376f7e26ad {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:18:29 devstack sudo[104805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.293afa29-057b-4579-9714-0e376f7e26ad
Sep 07 18:18:29 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:18:29 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.293afa29-057b-4579-9714-0e376f7e26ad" returned: 0 in 0.356s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-602cc49d-24be-4b69-8469-6f87dcd778c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b219c7d8-4cf7-4b05-a8c0-01f3519d5f7d]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:18:29 devstack sudo[104810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1
Sep 07 18:18:29 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:18:29 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1" returned: 0 in 0.354s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] will copy from snapshot at /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1 {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Creating direct copy from snapshot {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG cinder.utils [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Path /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8a20f363-88c1-4b16-9b06-d75447a82383 not found in is_blk_device check {{(pid=87269) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 07 18:18:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8a20f363-88c1-4b16-9b06-d75447a82383 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:18:30 devstack sudo[104815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8a20f363-88c1-4b16-9b06-d75447a82383
Sep 07 18:18:30 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:18:33 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root
Sep 07 18:18:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8a20f363-88c1-4b16-9b06-d75447a82383" returned: 0 in 3.977s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:18:33 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Image conversion details: src /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1, size 1024.00 MB, duration 3.98 sec, destination /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8a20f363-88c1-4b16-9b06-d75447a82383 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 07 18:18:33 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Converted 1024.00 MB image at 257.43 MB/s
Sep 07 18:18:33 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8a20f363-88c1-4b16-9b06-d75447a82383 is being set with open permissions: ugo+rw
Sep 07 18:18:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8a20f363-88c1-4b16-9b06-d75447a82383 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:18:33 devstack sudo[104828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8a20f363-88c1-4b16-9b06-d75447a82383
Sep 07 18:18:33 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:18:34 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root
Sep 07 18:18:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8a20f363-88c1-4b16-9b06-d75447a82383" returned: 0 in 0.232s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:18:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Lock "cinder-quobyte-8a20f363-88c1-4b16-9b06-d75447a82383" released by "_copy_volume_from_snapshot" :: held 4.990s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:18:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Lock "cinder-quobyte-293afa29-057b-4579-9714-0e376f7e26ad-8a20f363-88c1-4b16-9b06-d75447a82383" released by "_create_volume_from_snapshot" :: held 5.046s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:18:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.059s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:18:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f72507e-ee12-4568-83ec-ccf1caff47fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a20f363-88c1-4b16-9b06-d75447a82383', 'volume_size': 1, 'snapshot_id': '293afa29-057b-4579-9714-0e376f7e26ad'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:18:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b5eabb0-f3f2-4d44-9ade-6923467c1888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:18:34 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Volume volume-8a20f363-88c1-4b16-9b06-d75447a82383 (8a20f363-88c1-4b16-9b06-d75447a82383): created successfully
Sep 07 18:18:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b5eabb0-f3f2-4d44-9ade-6923467c1888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:18:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Flow 'volume_create_manager' (77446e83-473a-4f65-9f4c-b5b77bcdc6ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:18:34 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-bf2b6d80-880f-40c9-b8fb-ffb10079c1c3 tempest-SnapshotDependencyTests-1811703137 None] Created volume successfully.
Sep 07 18:18:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5f635531-1804-495c-8ac7-cd54bb90423d tempest-SnapshotDependencyTests-1811703137 None] Acquiring lock "cinder-293afa29-057b-4579-9714-0e376f7e26ad-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:18:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5f635531-1804-495c-8ac7-cd54bb90423d tempest-SnapshotDependencyTests-1811703137 None] Lock "cinder-293afa29-057b-4579-9714-0e376f7e26ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:18:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5f635531-1804-495c-8ac7-cd54bb90423d tempest-SnapshotDependencyTests-1811703137 None] Acquiring lock "cinder-quobyte-602cc49d-24be-4b69-8469-6f87dcd778c1" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:18:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5f635531-1804-495c-8ac7-cd54bb90423d tempest-SnapshotDependencyTests-1811703137 None] Lock "cinder-quobyte-602cc49d-24be-4b69-8469-6f87dcd778c1" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:18:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5f635531-1804-495c-8ac7-cd54bb90423d tempest-SnapshotDependencyTests-1811703137 None] Acquiring lock "cinder-quobyte-293afa29-057b-4579-9714-0e376f7e26ad" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:18:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5f635531-1804-495c-8ac7-cd54bb90423d tempest-SnapshotDependencyTests-1811703137 None] Lock "cinder-quobyte-293afa29-057b-4579-9714-0e376f7e26ad" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:18:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-5f635531-1804-495c-8ac7-cd54bb90423d tempest-SnapshotDependencyTests-1811703137 None] Deleting offline snapshot 293afa29-057b-4579-9714-0e376f7e26ad of volume 602cc49d-24be-4b69-8469-6f87dcd778c1 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:18:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-5f635531-1804-495c-8ac7-cd54bb90423d tempest-SnapshotDependencyTests-1811703137 None] snapshot_file for this snap is: volume-602cc49d-24be-4b69-8469-6f87dcd778c1.293afa29-057b-4579-9714-0e376f7e26ad {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:18:34 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c94a28b-559f-4a31-961f-3c3425c2ec4b]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:18:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5f635531-1804-495c-8ac7-cd54bb90423d tempest-SnapshotDependencyTests-1811703137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.293afa29-057b-4579-9714-0e376f7e26ad {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:18:34 devstack sudo[104831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.293afa29-057b-4579-9714-0e376f7e26ad
Sep 07 18:18:34 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:18:34 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root
Sep 07 18:18:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5f635531-1804-495c-8ac7-cd54bb90423d tempest-SnapshotDependencyTests-1811703137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.293afa29-057b-4579-9714-0e376f7e26ad" returned: 0 in 0.354s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:18:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-5f635531-1804-495c-8ac7-cd54bb90423d tempest-SnapshotDependencyTests-1811703137 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-602cc49d-24be-4b69-8469-6f87dcd778c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:18:35 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dcc050-b2f6-4c67-95f6-183ff966b5fe]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:18:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5f635531-1804-495c-8ac7-cd54bb90423d tempest-SnapshotDependencyTests-1811703137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:18:35 devstack sudo[104836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1
Sep 07 18:18:35 devstack sudo[104836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:18:35 devstack sudo[104836]: pam_unix(sudo:session): session closed for user root
Sep 07 18:18:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5f635531-1804-495c-8ac7-cd54bb90423d tempest-SnapshotDependencyTests-1811703137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1" returned: 0 in 0.523s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:18:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5f635531-1804-495c-8ac7-cd54bb90423d tempest-SnapshotDependencyTests-1811703137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.293afa29-057b-4579-9714-0e376f7e26ad {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:18:35 devstack sudo[104842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.293afa29-057b-4579-9714-0e376f7e26ad
Sep 07 18:18:35 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:18:35 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root
Sep 07 18:18:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5f635531-1804-495c-8ac7-cd54bb90423d tempest-SnapshotDependencyTests-1811703137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.293afa29-057b-4579-9714-0e376f7e26ad" returned: 0 in 0.334s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:18:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5f635531-1804-495c-8ac7-cd54bb90423d tempest-SnapshotDependencyTests-1811703137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.293afa29-057b-4579-9714-0e376f7e26ad {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:18:35 devstack sudo[104847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.293afa29-057b-4579-9714-0e376f7e26ad
Sep 07 18:18:35 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:18:36 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root
Sep 07 18:18:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5f635531-1804-495c-8ac7-cd54bb90423d tempest-SnapshotDependencyTests-1811703137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1.293afa29-057b-4579-9714-0e376f7e26ad" returned: 0 in 0.256s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:18:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5f635531-1804-495c-8ac7-cd54bb90423d tempest-SnapshotDependencyTests-1811703137 None] Lock "cinder-quobyte-293afa29-057b-4579-9714-0e376f7e26ad" released by "_delete_snapshot" :: held 1.556s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:18:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5f635531-1804-495c-8ac7-cd54bb90423d tempest-SnapshotDependencyTests-1811703137 None] Lock "cinder-quobyte-602cc49d-24be-4b69-8469-6f87dcd778c1" released by "delete_snapshot" :: held 1.577s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:18:36 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-5f635531-1804-495c-8ac7-cd54bb90423d tempest-SnapshotDependencyTests-1811703137 None] Created reservations ['a25f7fb0-18b0-4ec6-afb4-9f1d50040581', 'c1fed688-28ab-4a0a-a66a-e7fff2361ccb', 'bc27077a-2ab8-463b-9823-b6266826223e', '5e3b85a9-504b-40d1-9b60-3b7d4b11f36b'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:18:36 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5f635531-1804-495c-8ac7-cd54bb90423d tempest-SnapshotDependencyTests-1811703137 None] Delete snapshot completed successfully.
Sep 07 18:18:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5f635531-1804-495c-8ac7-cd54bb90423d tempest-SnapshotDependencyTests-1811703137 None] Lock "cinder-293afa29-057b-4579-9714-0e376f7e26ad-delete_snapshot" released by "delete_snapshot" :: held 1.705s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:18:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5a22263d-dd05-4719-b678-ab6bac43b797 tempest-SnapshotDependencyTests-1811703137 None] Acquiring lock "cinder-602cc49d-24be-4b69-8469-6f87dcd778c1-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:18:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5a22263d-dd05-4719-b678-ab6bac43b797 tempest-SnapshotDependencyTests-1811703137 None] Lock "cinder-602cc49d-24be-4b69-8469-6f87dcd778c1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:18:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5a22263d-dd05-4719-b678-ab6bac43b797 tempest-SnapshotDependencyTests-1811703137 None] Acquiring lock "cinder-quobyte-602cc49d-24be-4b69-8469-6f87dcd778c1" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:18:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5a22263d-dd05-4719-b678-ab6bac43b797 tempest-SnapshotDependencyTests-1811703137 None] Lock "cinder-quobyte-602cc49d-24be-4b69-8469-6f87dcd778c1" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:18:36 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded63948-d9b0-4f65-ac99-aab91143318d]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:18:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5a22263d-dd05-4719-b678-ab6bac43b797 tempest-SnapshotDependencyTests-1811703137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:18:36 devstack sudo[104851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1
Sep 07 18:18:36 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:18:37 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root
Sep 07 18:18:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5a22263d-dd05-4719-b678-ab6bac43b797 tempest-SnapshotDependencyTests-1811703137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1" returned: 0 in 0.349s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:18:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5a22263d-dd05-4719-b678-ab6bac43b797 tempest-SnapshotDependencyTests-1811703137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:18:37 devstack sudo[104856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1
Sep 07 18:18:37 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:18:37 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root
Sep 07 18:18:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5a22263d-dd05-4719-b678-ab6bac43b797 tempest-SnapshotDependencyTests-1811703137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-602cc49d-24be-4b69-8469-6f87dcd778c1" returned: 0 in 0.242s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:18:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5a22263d-dd05-4719-b678-ab6bac43b797 tempest-SnapshotDependencyTests-1811703137 None] Lock "cinder-quobyte-602cc49d-24be-4b69-8469-6f87dcd778c1" released by "delete_volume" :: held 0.646s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:18:37 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-5a22263d-dd05-4719-b678-ab6bac43b797 tempest-SnapshotDependencyTests-1811703137 None] Created reservations ['c6f073d7-4bb0-4a57-95cb-4856d37a4df7', 'c74fa3ee-e7bd-4306-8ac8-a4838f82f078', 'c592f53b-dbdb-47c4-a50d-7b79fc34f184', 'de06f3a1-9dc8-4352-9557-cc7002a2bdfd'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:18:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5a22263d-dd05-4719-b678-ab6bac43b797 tempest-SnapshotDependencyTests-1811703137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:18:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5a22263d-dd05-4719-b678-ab6bac43b797 tempest-SnapshotDependencyTests-1811703137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:18:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5a22263d-dd05-4719-b678-ab6bac43b797 tempest-SnapshotDependencyTests-1811703137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:18:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5a22263d-dd05-4719-b678-ab6bac43b797 tempest-SnapshotDependencyTests-1811703137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:18:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5a22263d-dd05-4719-b678-ab6bac43b797 tempest-SnapshotDependencyTests-1811703137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:18:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5a22263d-dd05-4719-b678-ab6bac43b797 tempest-SnapshotDependencyTests-1811703137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:18:37 devstack sudo[104859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:18:37 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:18:37 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root
Sep 07 18:18:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5a22263d-dd05-4719-b678-ab6bac43b797 tempest-SnapshotDependencyTests-1811703137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.237s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:18:37 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-5a22263d-dd05-4719-b678-ab6bac43b797 tempest-SnapshotDependencyTests-1811703137 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:18:37 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5a22263d-dd05-4719-b678-ab6bac43b797 tempest-SnapshotDependencyTests-1811703137 None] Deleted volume successfully.
Sep 07 18:18:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5a22263d-dd05-4719-b678-ab6bac43b797 tempest-SnapshotDependencyTests-1811703137 None] Lock "cinder-602cc49d-24be-4b69-8469-6f87dcd778c1-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:18:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2a9ce0e6-5ea5-4d21-a47f-bdf070739f2d tempest-SnapshotDependencyTests-1811703137 None] Acquiring lock "cinder-8a20f363-88c1-4b16-9b06-d75447a82383-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:18:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2a9ce0e6-5ea5-4d21-a47f-bdf070739f2d tempest-SnapshotDependencyTests-1811703137 None] Lock "cinder-8a20f363-88c1-4b16-9b06-d75447a82383-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:18:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2a9ce0e6-5ea5-4d21-a47f-bdf070739f2d tempest-SnapshotDependencyTests-1811703137 None] Acquiring lock "cinder-quobyte-8a20f363-88c1-4b16-9b06-d75447a82383" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:18:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2a9ce0e6-5ea5-4d21-a47f-bdf070739f2d tempest-SnapshotDependencyTests-1811703137 None] Lock "cinder-quobyte-8a20f363-88c1-4b16-9b06-d75447a82383" acquired by "delete_volume" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:18:37 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a1055c-f29a-46a8-8fa9-9316bcbfc81b]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:18:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2a9ce0e6-5ea5-4d21-a47f-bdf070739f2d tempest-SnapshotDependencyTests-1811703137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8a20f363-88c1-4b16-9b06-d75447a82383 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:18:38 devstack sudo[104865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8a20f363-88c1-4b16-9b06-d75447a82383
Sep 07 18:18:38 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:18:38 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root
Sep 07 18:18:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2a9ce0e6-5ea5-4d21-a47f-bdf070739f2d tempest-SnapshotDependencyTests-1811703137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8a20f363-88c1-4b16-9b06-d75447a82383" returned: 0 in 0.352s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:18:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2a9ce0e6-5ea5-4d21-a47f-bdf070739f2d tempest-SnapshotDependencyTests-1811703137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8a20f363-88c1-4b16-9b06-d75447a82383 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:18:38 devstack sudo[104870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8a20f363-88c1-4b16-9b06-d75447a82383
Sep 07 18:18:38 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:18:38 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root
Sep 07 18:18:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2a9ce0e6-5ea5-4d21-a47f-bdf070739f2d tempest-SnapshotDependencyTests-1811703137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8a20f363-88c1-4b16-9b06-d75447a82383" returned: 0 in 0.237s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:18:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2a9ce0e6-5ea5-4d21-a47f-bdf070739f2d tempest-SnapshotDependencyTests-1811703137 None] Lock "cinder-quobyte-8a20f363-88c1-4b16-9b06-d75447a82383" released by "delete_volume" :: held 0.629s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:18:38 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-2a9ce0e6-5ea5-4d21-a47f-bdf070739f2d tempest-SnapshotDependencyTests-1811703137 None] Created reservations ['18dad8a5-2f31-4d0b-a94b-f5184cc8b4e6', 'ee1c9e1c-a998-4a9f-bbad-4b925ea33bbe', '26c0e2f8-14a7-4210-9a65-5c3d38f986a9', '0132daf6-aebd-445a-a518-6bc8ceeff0a3'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:18:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2a9ce0e6-5ea5-4d21-a47f-bdf070739f2d tempest-SnapshotDependencyTests-1811703137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:18:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2a9ce0e6-5ea5-4d21-a47f-bdf070739f2d tempest-SnapshotDependencyTests-1811703137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:18:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2a9ce0e6-5ea5-4d21-a47f-bdf070739f2d tempest-SnapshotDependencyTests-1811703137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:18:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2a9ce0e6-5ea5-4d21-a47f-bdf070739f2d tempest-SnapshotDependencyTests-1811703137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:18:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2a9ce0e6-5ea5-4d21-a47f-bdf070739f2d tempest-SnapshotDependencyTests-1811703137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:18:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2a9ce0e6-5ea5-4d21-a47f-bdf070739f2d tempest-SnapshotDependencyTests-1811703137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:18:38 devstack sudo[104873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:18:38 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:18:38 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root
Sep 07 18:18:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2a9ce0e6-5ea5-4d21-a47f-bdf070739f2d tempest-SnapshotDependencyTests-1811703137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.236s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:18:38 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-2a9ce0e6-5ea5-4d21-a47f-bdf070739f2d tempest-SnapshotDependencyTests-1811703137 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:18:38 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2a9ce0e6-5ea5-4d21-a47f-bdf070739f2d tempest-SnapshotDependencyTests-1811703137 None] Deleted volume successfully.
Sep 07 18:18:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2a9ce0e6-5ea5-4d21-a47f-bdf070739f2d tempest-SnapshotDependencyTests-1811703137 None] Lock "cinder-8a20f363-88c1-4b16-9b06-d75447a82383-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:18:50 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=29,cinder:SELECT=24,cinder:INSERT=7 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:18:50 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=26,cinder:UPDATE=30,cinder:INSERT=8,cinder:DELETE=5 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Flow 'volume_create_manager' (6ec36006-7112-4565-9499-1e73996c0af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7fa1a0c-b150-42f1-aac3-27d31b0d8694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7fa1a0c-b150-42f1-aac3-27d31b0d8694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-691421250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d179591d-1728-4a60-bf91-926bc9c377f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb2adf969434a4a8d3a1fb194394ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:18:59Z,use_quota=True,user_id='d1fe744f24a24f18b3a073dc44e54db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c056076d-528c-4f61-8c60-de09373a1d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c056076d-528c-4f61-8c60-de09373a1d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70beb658-9904-404d-b03c-e3217a61ac1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70beb658-9904-404d-b03c-e3217a61ac1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd179591d-1728-4a60-bf91-926bc9c377f7', 'volume_name': 'volume-d179591d-1728-4a60-bf91-926bc9c377f7', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6721e4a4-eb84-480f-85b7-afb1b5df43ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6721e4a4-eb84-480f-85b7-afb1b5df43ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a15c7b-2468-4e19-af89-c5527218e589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:18:59 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Volume d179591d-1728-4a60-bf91-926bc9c377f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d179591d-1728-4a60-bf91-926bc9c377f7', 'volume_size': 1}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-691421250',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d179591d-1728-4a60-bf91-926bc9c377f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb2adf969434a4a8d3a1fb194394ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:18:59Z,use_quota=True,user_id='d1fe744f24a24f18b3a073dc44e54db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Creating volume d179591d-1728-4a60-bf91-926bc9c377f7 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:18:59 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d179591d-1728-4a60-bf91-926bc9c377f7 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:18:59 devstack sudo[104919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d179591d-1728-4a60-bf91-926bc9c377f7 1073741824
Sep 07 18:18:59 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Flow 'volume_create_manager' (cbba73b7-3ba1-4022-aab2-b676c178ac84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3cfaa8f-6d11-4324-912d-0ca3c6a47c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3cfaa8f-6d11-4324-912d-0ca3c6a47c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-313035548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd38f47-f826-4762-a433-bb0ebe6939a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5466302516254de09e6ea7b13e12e04b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:00Z,use_quota=True,user_id='2ae88396d75b4c43b3d3317bb3d21af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a396c7db-9129-4900-bd8f-49c99c922993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a396c7db-9129-4900-bd8f-49c99c922993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33615bb-90a0-422f-bf77-b8a9b06b6bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33615bb-90a0-422f-bf77-b8a9b06b6bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edd38f47-f826-4762-a433-bb0ebe6939a8', 'volume_name': 'volume-edd38f47-f826-4762-a433-bb0ebe6939a8', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3967263-ca91-4c6b-bdfb-6bb771b09590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3967263-ca91-4c6b-bdfb-6bb771b09590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b000aaa-6750-4a19-9d29-ff7b056335b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:18:59 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Volume edd38f47-f826-4762-a433-bb0ebe6939a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edd38f47-f826-4762-a433-bb0ebe6939a8', 'volume_size': 1}
Sep 07 18:18:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Flow 'volume_create_manager' (9eb21c2e-10d2-40f4-8382-257f8a64732f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff30030-366b-4074-9bae-bb563f6f844c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ff30030-366b-4074-9bae-bb563f6f844c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1333954820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2976b47-bd91-47fa-a79b-fa7f8b529a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4180d18445345d78a8e76d1127c1918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:00Z,use_quota=True,user_id='b654519c323649339479de098895a307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97834f63-3650-4135-8bcc-e083aa4d86e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97834f63-3650-4135-8bcc-e083aa4d86e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298210ec-134d-401a-8e3f-3df37b38724d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:00 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (298210ec-134d-401a-8e3f-3df37b38724d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2976b47-bd91-47fa-a79b-fa7f8b529a7b', 'volume_name': 'volume-b2976b47-bd91-47fa-a79b-fa7f8b529a7b', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a601c296-5f0c-44ec-a2a6-12ea453a68c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a601c296-5f0c-44ec-a2a6-12ea453a68c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7703cc98-ed00-40db-bb0e-3ca9ecd5d17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:00 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Volume b2976b47-bd91-47fa-a79b-fa7f8b529a7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2976b47-bd91-47fa-a79b-fa7f8b529a7b', 'volume_size': 1}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d179591d-1728-4a60-bf91-926bc9c377f7 1073741824" returned: 0 in 0.692s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d179591d-1728-4a60-bf91-926bc9c377f7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:00 devstack sudo[104925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d179591d-1728-4a60-bf91-926bc9c377f7
Sep 07 18:19:00 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Flow 'volume_create_manager' (f981d4fa-6d38-404a-9ba2-499a9fd71722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2765578d-efaf-4af2-beec-c135bc8c63e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:00 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2765578d-efaf-4af2-beec-c135bc8c63e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1223339501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc38c657-a996-4556-afe8-e0af4ece341e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4180d18445345d78a8e76d1127c1918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:01Z,use_quota=True,user_id='b654519c323649339479de098895a307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77bdab64-12ee-40e3-97bb-53e53f7e9335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77bdab64-12ee-40e3-97bb-53e53f7e9335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58f08b2b-f9b3-4684-8628-ca6355e97dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58f08b2b-f9b3-4684-8628-ca6355e97dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc38c657-a996-4556-afe8-e0af4ece341e', 'volume_name': 'volume-fc38c657-a996-4556-afe8-e0af4ece341e', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6ac32d-b043-4c1b-8eec-681425ae537e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6ac32d-b043-4c1b-8eec-681425ae537e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b17ab3b7-b053-45bd-acf2-8eb5aa32bbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:00 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Volume fc38c657-a996-4556-afe8-e0af4ece341e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc38c657-a996-4556-afe8-e0af4ece341e', 'volume_size': 1}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d179591d-1728-4a60-bf91-926bc9c377f7" returned: 0 in 0.457s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.038s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-313035548',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd38f47-f826-4762-a433-bb0ebe6939a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5466302516254de09e6ea7b13e12e04b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:00Z,use_quota=True,user_id='2ae88396d75b4c43b3d3317bb3d21af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Creating volume edd38f47-f826-4762-a433-bb0ebe6939a8 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:19:00 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a15c7b-2468-4e19-af89-c5527218e589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d179591d-1728-4a60-bf91-926bc9c377f7', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:00 devstack sudo[104928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8 1073741824
Sep 07 18:19:00 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be3a7ad-2c75-4868-a270-4c84d580c1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:00 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Volume volume-d179591d-1728-4a60-bf91-926bc9c377f7 (d179591d-1728-4a60-bf91-926bc9c377f7): created successfully
Sep 07 18:19:00 devstack sudo[104930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:19:00 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0be3a7ad-2c75-4868-a270-4c84d580c1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Flow 'volume_create_manager' (6ec36006-7112-4565-9499-1e73996c0af5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:00 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d35440d5-eaa0-4080-86fb-965874c20f21 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Created volume successfully.
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Flow 'volume_create_manager' (307ac7be-1cc1-40d3-adb8-64f92d6dac9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (758ba5e0-1e78-4992-bde5-a73953e41c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (758ba5e0-1e78-4992-bde5-a73953e41c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-837775845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315c3719-26e9-47ae-97b5-eb68e71ad5e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4180d18445345d78a8e76d1127c1918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:01Z,use_quota=True,user_id='b654519c323649339479de098895a307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:01 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ce2ca2-74a8-463a-bc6d-ba8c2820170c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ce2ca2-74a8-463a-bc6d-ba8c2820170c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5021e391-7013-44a6-984b-28f16a201dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5021e391-7013-44a6-984b-28f16a201dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '315c3719-26e9-47ae-97b5-eb68e71ad5e4', 'volume_name': 'volume-315c3719-26e9-47ae-97b5-eb68e71ad5e4', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad30ce9b-a40b-4858-be95-ecac4923974c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad30ce9b-a40b-4858-be95-ecac4923974c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (268d3f08-90ec-4eea-9efe-d9c5794e73a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:01 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Volume 315c3719-26e9-47ae-97b5-eb68e71ad5e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-315c3719-26e9-47ae-97b5-eb68e71ad5e4', 'volume_size': 1}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.399s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread info: [<_MainThread(MainThread, started 137533762306176)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137533650971072)>, <Thread(Thread-3 (stat_writer), started daemon 137533647226880)>, <Thread(Rabbit-heartbeat, started daemon 137533647437120)>, <Thread(Thread-5 (_runner), started daemon 137533648120896)>, <Thread(Thread-7 (_runner), started daemon 137533648182592)>, <Thread(fd_logger, started daemon 137533644336576)>, <Thread(privsep_reader, started daemon 137533643255424)>, <Thread(tpool_thread_0, started daemon 137533635446464)>, <Thread(tpool_thread_1, started daemon 137533627053760)>, <Thread(tpool_thread_2, started daemon 137533618661056)>, <Thread(tpool_thread_3, started daemon 137533610251968)>, <Thread(tpool_thread_4, started daemon 137533601842880)>, <Thread(tpool_thread_5, started daemon 137533593433792)>, <Thread(tpool_thread_6, started daemon 137533585024704)>, <Thread(tpool_thread_7, started daemon 137533576615616)>, <Thread(tpool_thread_8, started daemon 137533568206528)>, <Thread(tpool_thread_9, started daemon 137533559797440)>, <Thread(tpool_thread_10, started daemon 137533551388352)>, <Thread(tpool_thread_11, started daemon 137533542979264)>, <Thread(tpool_thread_12, started daemon 137533534570176)>, <Thread(tpool_thread_13, started daemon 137533526161088)>, <Thread(tpool_thread_14, started daemon 137533517752000)>, <Thread(tpool_thread_15, started daemon 137533509342912)>, <Thread(tpool_thread_16, started daemon 137533500933824)>, <Thread(tpool_thread_17, started daemon 137533492524736)>, <Thread(tpool_thread_18, started daemon 137533484115648)>, <Thread(tpool_thread_19, started daemon 137533475706560)>] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 07 18:19:01 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8 1073741824" returned: 0 in 0.567s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:01 devstack sudo[104937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8
Sep 07 18:19:01 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Flow 'volume_create_manager' (8b751b22-03dd-4fe1-901d-ddb83eb809d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9b20d2-bc87-49a8-9baf-9bd90ccf5ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9b20d2-bc87-49a8-9baf-9bd90ccf5ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-447632285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fbef953-32db-4f21-ba7d-4e6e115146ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4180d18445345d78a8e76d1127c1918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:01Z,use_quota=True,user_id='b654519c323649339479de098895a307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be80c5fb-0456-4ea3-a798-589cdaae74ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be80c5fb-0456-4ea3-a798-589cdaae74ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6838b449-6afc-4476-880d-c057515b8239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6838b449-6afc-4476-880d-c057515b8239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fbef953-32db-4f21-ba7d-4e6e115146ec', 'volume_name': 'volume-1fbef953-32db-4f21-ba7d-4e6e115146ec', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbb353ec-e769-43de-b0ce-041f8b338b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbb353ec-e769-43de-b0ce-041f8b338b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddf9e492-dc5a-42f1-b478-e2405293e23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:01 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Volume 1fbef953-32db-4f21-ba7d-4e6e115146ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fbef953-32db-4f21-ba7d-4e6e115146ec', 'volume_size': 1}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:01 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8" returned: 0 in 0.334s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.455s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1333954820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2976b47-bd91-47fa-a79b-fa7f8b529a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4180d18445345d78a8e76d1127c1918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:00Z,use_quota=True,user_id='b654519c323649339479de098895a307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Creating volume b2976b47-bd91-47fa-a79b-fa7f8b529a7b {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:19:01 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b2976b47-bd91-47fa-a79b-fa7f8b529a7b 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:01 devstack sudo[104940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b2976b47-bd91-47fa-a79b-fa7f8b529a7b 1073741824
Sep 07 18:19:01 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b000aaa-6750-4a19-9d29-ff7b056335b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edd38f47-f826-4762-a433-bb0ebe6939a8', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abcfa2af-9fe5-43bb-b4e2-d3d47f60f758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:01 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Volume volume-edd38f47-f826-4762-a433-bb0ebe6939a8 (edd38f47-f826-4762-a433-bb0ebe6939a8): created successfully
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abcfa2af-9fe5-43bb-b4e2-d3d47f60f758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Flow 'volume_create_manager' (cbba73b7-3ba1-4022-aab2-b676c178ac84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:01 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-17126b47-144a-4abe-8d1a-08f463d7fdf0 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Created volume successfully.
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Flow 'volume_create_manager' (bcc0c368-6902-470c-a927-dfaec853a7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b1e08f1-7bb9-43be-ba38-abe4b874453a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b1e08f1-7bb9-43be-ba38-abe4b874453a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-641491884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f020d9c-f013-4b15-9c92-64b9241372d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4180d18445345d78a8e76d1127c1918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:02Z,use_quota=True,user_id='b654519c323649339479de098895a307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22855362-9010-4de4-b35d-36e5638bd224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22855362-9010-4de4-b35d-36e5638bd224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd150e9-3c0d-4af7-986a-c6f2f6a6bd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bd150e9-3c0d-4af7-986a-c6f2f6a6bd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f020d9c-f013-4b15-9c92-64b9241372d6', 'volume_name': 'volume-5f020d9c-f013-4b15-9c92-64b9241372d6', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd71c70-094e-44a3-bb93-67aa62300144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd71c70-094e-44a3-bb93-67aa62300144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db6cb749-4215-4046-ade0-1926924740dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:02 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Volume 5f020d9c-f013-4b15-9c92-64b9241372d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f020d9c-f013-4b15-9c92-64b9241372d6', 'volume_size': 1}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:02 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b2976b47-bd91-47fa-a79b-fa7f8b529a7b 1073741824" returned: 0 in 0.615s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Flow 'volume_create_manager' (e5adf688-93d3-4299-acba-00484ca6c5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2de6680-0662-4438-aa30-7261b1dd5f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b2976b47-bd91-47fa-a79b-fa7f8b529a7b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2de6680-0662-4438-aa30-7261b1dd5f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1918351683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f54a19-231d-411b-b28c-4d24fa86e586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb2adf969434a4a8d3a1fb194394ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:02Z,use_quota=True,user_id='d1fe744f24a24f18b3a073dc44e54db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff9f34a-d15d-409a-9cec-64dd3d594771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:02 devstack sudo[104946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b2976b47-bd91-47fa-a79b-fa7f8b529a7b
Sep 07 18:19:02 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff9f34a-d15d-409a-9cec-64dd3d594771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d03c9ae4-f3d3-404c-a6a5-4db299e2020b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d03c9ae4-f3d3-404c-a6a5-4db299e2020b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58f54a19-231d-411b-b28c-4d24fa86e586', 'volume_name': 'volume-58f54a19-231d-411b-b28c-4d24fa86e586', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edccaf0d-426b-45e0-b41b-041a8238eaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edccaf0d-426b-45e0-b41b-041a8238eaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd692c24-d067-43cb-ac55-8c93f5e63478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:02 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Volume 58f54a19-231d-411b-b28c-4d24fa86e586: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58f54a19-231d-411b-b28c-4d24fa86e586', 'volume_size': 1}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:19:02 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Flow 'volume_create_manager' (06d3b59f-6592-48e1-bd4e-302f6cb0f790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb2b4bf-5bab-47b1-9fc1-974586491154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b2976b47-bd91-47fa-a79b-fa7f8b529a7b" returned: 0 in 0.391s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.117s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1223339501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc38c657-a996-4556-afe8-e0af4ece341e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4180d18445345d78a8e76d1127c1918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:01Z,use_quota=True,user_id='b654519c323649339479de098895a307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Creating volume fc38c657-a996-4556-afe8-e0af4ece341e {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:19:02 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fc38c657-a996-4556-afe8-e0af4ece341e 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:02 devstack sudo[104949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fc38c657-a996-4556-afe8-e0af4ece341e 1073741824
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb2b4bf-5bab-47b1-9fc1-974586491154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-957290376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3473c43a-ab9b-44ee-b302-afb409d81aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb2adf969434a4a8d3a1fb194394ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:03Z,use_quota=True,user_id='d1fe744f24a24f18b3a073dc44e54db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:02 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eada672-08cb-4a6c-a62a-cdcb82be160a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:02 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eada672-08cb-4a6c-a62a-cdcb82be160a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53409c4-4adf-4672-91ee-645839bbada4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d53409c4-4adf-4672-91ee-645839bbada4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3473c43a-ab9b-44ee-b302-afb409d81aaa', 'volume_name': 'volume-3473c43a-ab9b-44ee-b302-afb409d81aaa', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ad6a6c-529a-42fe-aa57-b5b5c9200650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ad6a6c-529a-42fe-aa57-b5b5c9200650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2398375-7f72-49e6-9dd7-e1fd9b9962de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:03 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Volume 3473c43a-ab9b-44ee-b302-afb409d81aaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3473c43a-ab9b-44ee-b302-afb409d81aaa', 'volume_size': 1}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7703cc98-ed00-40db-bb0e-3ca9ecd5d17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2976b47-bd91-47fa-a79b-fa7f8b529a7b', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29fbd301-010f-42a0-92b4-e8719a54eda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:03 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Volume volume-b2976b47-bd91-47fa-a79b-fa7f8b529a7b (b2976b47-bd91-47fa-a79b-fa7f8b529a7b): created successfully
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29fbd301-010f-42a0-92b4-e8719a54eda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Flow 'volume_create_manager' (9eb21c2e-10d2-40f4-8382-257f8a64732f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:03 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-05fe0809-65c2-487d-92c8-f04b6d7f3d8f tempest-CreateVolumesFromImageTest-656920226 None] Created volume successfully.
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dd0eda62-7864-4ee5-b7d1-6d5f92fc1e2c tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:19:03 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Flow 'volume_create_manager' (4811e166-58c6-49b8-92a2-db26dd1db779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18df8de-3525-4eaf-964a-64ca377c5702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fc38c657-a996-4556-afe8-e0af4ece341e 1073741824" returned: 0 in 0.649s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18df8de-3525-4eaf-964a-64ca377c5702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1331926644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf32c7d-fcc2-4930-bebb-371e238f3f0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb2adf969434a4a8d3a1fb194394ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:03Z,use_quota=True,user_id='d1fe744f24a24f18b3a073dc44e54db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42237aa8-1119-4114-8812-caa91f8a148b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42237aa8-1119-4114-8812-caa91f8a148b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e1a250-34ce-4725-84c8-8384cf34c93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e1a250-34ce-4725-84c8-8384cf34c93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cf32c7d-fcc2-4930-bebb-371e238f3f0e', 'volume_name': 'volume-6cf32c7d-fcc2-4930-bebb-371e238f3f0e', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8109847a-52ed-4e32-b779-3114136e7a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8109847a-52ed-4e32-b779-3114136e7a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c8e3f1-7406-436b-b803-403dc41260c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:03 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Volume 6cf32c7d-fcc2-4930-bebb-371e238f3f0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cf32c7d-fcc2-4930-bebb-371e238f3f0e', 'volume_size': 1}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fc38c657-a996-4556-afe8-e0af4ece341e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:03 devstack sudo[104955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fc38c657-a996-4556-afe8-e0af4ece341e
Sep 07 18:19:03 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Flow 'volume_create_manager' (9ff41431-1478-4f61-9cd4-24c1bdf41c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20ab143a-a053-4710-8259-304a896282f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:03 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fc38c657-a996-4556-afe8-e0af4ece341e" returned: 0 in 0.329s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.745s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-837775845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=315c3719-26e9-47ae-97b5-eb68e71ad5e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4180d18445345d78a8e76d1127c1918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:01Z,use_quota=True,user_id='b654519c323649339479de098895a307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Creating volume 315c3719-26e9-47ae-97b5-eb68e71ad5e4 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:19:03 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:19:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-315c3719-26e9-47ae-97b5-eb68e71ad5e4 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20ab143a-a053-4710-8259-304a896282f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1172733077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b8c741-209c-4af5-b9e2-753dab4bd3bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb2adf969434a4a8d3a1fb194394ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:04Z,use_quota=True,user_id='d1fe744f24a24f18b3a073dc44e54db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9834ccac-d604-4573-a4a8-8728329ccb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9834ccac-d604-4573-a4a8-8728329ccb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb95eec-547d-4d26-8a7b-fca96b3cce93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:04 devstack sudo[104958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-315c3719-26e9-47ae-97b5-eb68e71ad5e4 1073741824
Sep 07 18:19:04 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb95eec-547d-4d26-8a7b-fca96b3cce93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81b8c741-209c-4af5-b9e2-753dab4bd3bc', 'volume_name': 'volume-81b8c741-209c-4af5-b9e2-753dab4bd3bc', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d4732c-5fb2-4b7f-8c32-be8be1774825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d4732c-5fb2-4b7f-8c32-be8be1774825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c5b0f3-77d2-47d8-9ef3-0b343a784ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:04 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Volume 81b8c741-209c-4af5-b9e2-753dab4bd3bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81b8c741-209c-4af5-b9e2-753dab4bd3bc', 'volume_size': 1}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b17ab3b7-b053-45bd-acf2-8eb5aa32bbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc38c657-a996-4556-afe8-e0af4ece341e', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf8eb097-cbad-4f56-bbb8-58cec5fafe5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:04 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Volume volume-fc38c657-a996-4556-afe8-e0af4ece341e (fc38c657-a996-4556-afe8-e0af4ece341e): created successfully
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf8eb097-cbad-4f56-bbb8-58cec5fafe5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Flow 'volume_create_manager' (f981d4fa-6d38-404a-9ba2-499a9fd71722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:04 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-521352fd-9e1d-4a9c-aca4-0406bfe65443 tempest-CreateVolumesFromImageTest-656920226 None] Created volume successfully.
Sep 07 18:19:04 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-315c3719-26e9-47ae-97b5-eb68e71ad5e4 1073741824" returned: 0 in 0.496s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-315c3719-26e9-47ae-97b5-eb68e71ad5e4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:04 devstack sudo[104964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-315c3719-26e9-47ae-97b5-eb68e71ad5e4
Sep 07 18:19:04 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Flow 'volume_create_manager' (fd76599b-4e3b-4d9d-9eaf-1ded770ebd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bebf8065-15e8-4ed4-9e68-3ca974c5a4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bebf8065-15e8-4ed4-9e68-3ca974c5a4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1596072563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cca7252-88e4-47d4-8539-dcc4ec522ed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb2adf969434a4a8d3a1fb194394ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:04Z,use_quota=True,user_id='d1fe744f24a24f18b3a073dc44e54db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4edf35a9-097b-401d-9125-2b28129cb407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4edf35a9-097b-401d-9125-2b28129cb407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19963bf7-f410-4410-834a-9755ea338b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19963bf7-f410-4410-834a-9755ea338b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cca7252-88e4-47d4-8539-dcc4ec522ed9', 'volume_name': 'volume-5cca7252-88e4-47d4-8539-dcc4ec522ed9', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31a6a3f-dd03-48f7-bf36-48f48b567ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31a6a3f-dd03-48f7-bf36-48f48b567ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1009f7c-b770-46f9-829b-6e02deb433be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:04 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Volume 5cca7252-88e4-47d4-8539-dcc4ec522ed9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cca7252-88e4-47d4-8539-dcc4ec522ed9', 'volume_size': 1}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Flow 'volume_create_manager' (01870308-2144-46f4-ade2-77a1fd51e178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d247b95-a84b-49b9-a1b6-e3497443cf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d247b95-a84b-49b9-a1b6-e3497443cf7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c62783-0d55-4d48-b9b8-0f12505ef625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d94f780c26c04483843c9a74e44cc557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:05Z,use_quota=True,user_id='a33567c60beb4403bdc0a8ec1e7c8222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3256b1d0-53a9-47b3-89a8-9b93ab2fc48a),volume_type_id=3256b1d0-53a9-47b3-89a8-9b93ab2fc48a)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e60b371-1120-468b-bbdb-2a6ab7481e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e60b371-1120-468b-bbdb-2a6ab7481e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (750b7c56-3f40-409e-97c0-e93afbb2a398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.image.glance [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Creating Keystone auth plugin from conf {{(pid=87269) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 07 18:19:04 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-315c3719-26e9-47ae-97b5-eb68e71ad5e4" returned: 0 in 0.266s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.065s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-447632285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fbef953-32db-4f21-ba7d-4e6e115146ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4180d18445345d78a8e76d1127c1918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:01Z,use_quota=True,user_id='b654519c323649339479de098895a307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Creating volume 1fbef953-32db-4f21-ba7d-4e6e115146ec {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:19:04 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fbef953-32db-4f21-ba7d-4e6e115146ec 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (268d3f08-90ec-4eea-9efe-d9c5794e73a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-315c3719-26e9-47ae-97b5-eb68e71ad5e4', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a184378-61e5-4351-aa9d-6834454c2b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:04 devstack sudo[104967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fbef953-32db-4f21-ba7d-4e6e115146ec 1073741824
Sep 07 18:19:04 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:04 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Volume volume-315c3719-26e9-47ae-97b5-eb68e71ad5e4 (315c3719-26e9-47ae-97b5-eb68e71ad5e4): created successfully
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a184378-61e5-4351-aa9d-6834454c2b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:04 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Flow 'volume_create_manager' (307ac7be-1cc1-40d3-adb8-64f92d6dac9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:04 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-cf4c9032-082b-4e49-9d58-08c3ac61080f tempest-CreateVolumesFromImageTest-656920226 None] Created volume successfully.
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (750b7c56-3f40-409e-97c0-e93afbb2a398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd5c62783-0d55-4d48-b9b8-0f12505ef625', 'volume_name': 'volume-d5c62783-0d55-4d48-b9b8-0f12505ef625', 'volume_size': 1, 'image_id': '2a3554da-9b18-4c8d-a64f-2c347560b016', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2a3554da-9b18-4c8d-a64f-2c347560b016', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '460d9f5e2fda852b5c24c73f1f663e14', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd94f780c26c04483843c9a74e44cc557', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'da180f07a96279e646b265a2e6441e695a55ae1ee73d6e287f0f6b8b1b303396fcf5634c67b677a3fc68e3ae6cc04cc37e108e54f6cefa163648d5b1a58cec38', 'id': '2a3554da-9b18-4c8d-a64f-2c347560b016', 'created_at': datetime.datetime(2026, 9, 7, 16, 19, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 16, 19, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2a3554da-9b18-4c8d-a64f-2c347560b016/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d1601706c00>}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b165c7b-eff9-49a0-8d71-a6ca33601ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b165c7b-eff9-49a0-8d71-a6ca33601ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (303723f3-05b3-4a75-b434-14862e9364cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:05 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Volume d5c62783-0d55-4d48-b9b8-0f12505ef625: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d5c62783-0d55-4d48-b9b8-0f12505ef625', 'volume_size': 1, 'image_id': '2a3554da-9b18-4c8d-a64f-2c347560b016', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2a3554da-9b18-4c8d-a64f-2c347560b016', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '460d9f5e2fda852b5c24c73f1f663e14', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd94f780c26c04483843c9a74e44cc557', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'da180f07a96279e646b265a2e6441e695a55ae1ee73d6e287f0f6b8b1b303396fcf5634c67b677a3fc68e3ae6cc04cc37e108e54f6cefa163648d5b1a58cec38', 'id': '2a3554da-9b18-4c8d-a64f-2c347560b016', 'created_at': datetime.datetime(2026, 9, 7, 16, 19, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 16, 19, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2a3554da-9b18-4c8d-a64f-2c347560b016/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d1601706c00>}
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Trying to clone d5c62783-0d55-4d48-b9b8-0f12505ef625 from image 2a3554da-9b18-4c8d-a64f-2c347560b016 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2a3554da-9b18-4c8d-a64f-2c347560b016', 'metadata': {}}]). {{(pid=87269) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2a3554da-9b18-4c8d-a64f-2c347560b016_jlctjqdbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 07 18:19:05 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Image download 0.00 MB at 0.00 MB/s
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e241ea9-bf2c-4b8d-b545-5309b74791ac]: (4, 'raw') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a3554da-9b18-4c8d-a64f-2c347560b016_jlctjqdbdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:05 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fbef953-32db-4f21-ba7d-4e6e115146ec 1073741824" returned: 0 in 0.450s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:05 devstack sudo[104973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a3554da-9b18-4c8d-a64f-2c347560b016_jlctjqdbdevstack@QuobyteHD
Sep 07 18:19:05 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fbef953-32db-4f21-ba7d-4e6e115146ec {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:05 devstack sudo[104975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fbef953-32db-4f21-ba7d-4e6e115146ec
Sep 07 18:19:05 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:05 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a3554da-9b18-4c8d-a64f-2c347560b016_jlctjqdbdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a3554da-9b18-4c8d-a64f-2c347560b016_jlctjqdbdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:05 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fbef953-32db-4f21-ba7d-4e6e115146ec" returned: 0 in 0.285s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.340s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-641491884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f020d9c-f013-4b15-9c92-64b9241372d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4180d18445345d78a8e76d1127c1918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:02Z,use_quota=True,user_id='b654519c323649339479de098895a307',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Creating volume 5f020d9c-f013-4b15-9c92-64b9241372d6 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:19:05 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5f020d9c-f013-4b15-9c92-64b9241372d6 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:05 devstack sudo[104981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5f020d9c-f013-4b15-9c92-64b9241372d6 1073741824
Sep 07 18:19:05 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddf9e492-dc5a-42f1-b478-e2405293e23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fbef953-32db-4f21-ba7d-4e6e115146ec', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:05 devstack sudo[104980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a3554da-9b18-4c8d-a64f-2c347560b016_jlctjqdbdevstack@QuobyteHD
Sep 07 18:19:05 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab871b7-a17c-4d3e-87f9-359070b9256a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:05 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Volume volume-1fbef953-32db-4f21-ba7d-4e6e115146ec (1fbef953-32db-4f21-ba7d-4e6e115146ec): created successfully
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab871b7-a17c-4d3e-87f9-359070b9256a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Flow 'volume_create_manager' (8b751b22-03dd-4fe1-901d-ddb83eb809d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:05 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-fe21dcc1-953d-41c7-88f7-36628216b25c tempest-CreateVolumesFromImageTest-656920226 None] Created volume successfully.
Sep 07 18:19:05 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a3554da-9b18-4c8d-a64f-2c347560b016_jlctjqdbdevstack@QuobyteHD" returned: 1 in 0.346s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a3554da-9b18-4c8d-a64f-2c347560b016_jlctjqdbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Temporary image 2a3554da-9b18-4c8d-a64f-2c347560b016 is fetched for user a33567c60beb4403bdc0a8ec1e7c8222. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb661b1c-e5e1-4a2e-a2fe-d19a566bd090]: (4, 'raw') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a3554da-9b18-4c8d-a64f-2c347560b016_jlctjqdbdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:06 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5f020d9c-f013-4b15-9c92-64b9241372d6 1073741824" returned: 0 in 0.461s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:06 devstack sudo[104991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a3554da-9b18-4c8d-a64f-2c347560b016_jlctjqdbdevstack@QuobyteHD
Sep 07 18:19:06 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5f020d9c-f013-4b15-9c92-64b9241372d6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:06 devstack sudo[104993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5f020d9c-f013-4b15-9c92-64b9241372d6
Sep 07 18:19:06 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:06 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a3554da-9b18-4c8d-a64f-2c347560b016_jlctjqdbdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a3554da-9b18-4c8d-a64f-2c347560b016_jlctjqdbdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:06 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5f020d9c-f013-4b15-9c92-64b9241372d6" returned: 0 in 0.243s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.763s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1918351683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f54a19-231d-411b-b28c-4d24fa86e586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb2adf969434a4a8d3a1fb194394ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:02Z,use_quota=True,user_id='d1fe744f24a24f18b3a073dc44e54db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Creating volume 58f54a19-231d-411b-b28c-4d24fa86e586 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:19:06 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-58f54a19-231d-411b-b28c-4d24fa86e586 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:06 devstack sudo[104999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-58f54a19-231d-411b-b28c-4d24fa86e586 1073741824
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db6cb749-4215-4046-ade0-1926924740dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f020d9c-f013-4b15-9c92-64b9241372d6', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:06 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7b52e2-a5b7-4cfb-8da9-90d2e0c3ae74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:06 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Volume volume-5f020d9c-f013-4b15-9c92-64b9241372d6 (5f020d9c-f013-4b15-9c92-64b9241372d6): created successfully
Sep 07 18:19:06 devstack sudo[104998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a3554da-9b18-4c8d-a64f-2c347560b016_jlctjqdbdevstack@QuobyteHD
Sep 07 18:19:06 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7b52e2-a5b7-4cfb-8da9-90d2e0c3ae74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Flow 'volume_create_manager' (bcc0c368-6902-470c-a927-dfaec853a7ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:06 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-dd2951e0-dc11-49e3-98f4-14b32e95ac7c tempest-CreateVolumesFromImageTest-656920226 None] Created volume successfully.
Sep 07 18:19:06 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a3554da-9b18-4c8d-a64f-2c347560b016_jlctjqdbdevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a3554da-9b18-4c8d-a64f-2c347560b016_jlctjqdbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d2b1b2b8-972c-46dd-8491-af163f7c6cf2 tempest-CreateVolumesFromImageTest-656920226 None] Acquiring lock "cinder-5f020d9c-f013-4b15-9c92-64b9241372d6-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d2b1b2b8-972c-46dd-8491-af163f7c6cf2 tempest-CreateVolumesFromImageTest-656920226 None] Lock "cinder-5f020d9c-f013-4b15-9c92-64b9241372d6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:06 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-58f54a19-231d-411b-b28c-4d24fa86e586 1073741824" returned: 0 in 0.489s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d2b1b2b8-972c-46dd-8491-af163f7c6cf2 tempest-CreateVolumesFromImageTest-656920226 None] Acquiring lock "cinder-quobyte-5f020d9c-f013-4b15-9c92-64b9241372d6" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d2b1b2b8-972c-46dd-8491-af163f7c6cf2 tempest-CreateVolumesFromImageTest-656920226 None] Lock "cinder-quobyte-5f020d9c-f013-4b15-9c92-64b9241372d6" acquired by "delete_volume" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-58f54a19-231d-411b-b28c-4d24fa86e586 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae517775-1478-4e13-8698-87a51ea6634e]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d2b1b2b8-972c-46dd-8491-af163f7c6cf2 tempest-CreateVolumesFromImageTest-656920226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5f020d9c-f013-4b15-9c92-64b9241372d6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:06 devstack sudo[105010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-58f54a19-231d-411b-b28c-4d24fa86e586
Sep 07 18:19:06 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:07 devstack sudo[105011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5f020d9c-f013-4b15-9c92-64b9241372d6
Sep 07 18:19:07 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:07 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-58f54a19-231d-411b-b28c-4d24fa86e586" returned: 0 in 0.252s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.102s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-957290376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3473c43a-ab9b-44ee-b302-afb409d81aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb2adf969434a4a8d3a1fb194394ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:03Z,use_quota=True,user_id='d1fe744f24a24f18b3a073dc44e54db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Creating volume 3473c43a-ab9b-44ee-b302-afb409d81aaa {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:19:07 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3473c43a-ab9b-44ee-b302-afb409d81aaa 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd692c24-d067-43cb-ac55-8c93f5e63478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58f54a19-231d-411b-b28c-4d24fa86e586', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:07 devstack sudo[105015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3473c43a-ab9b-44ee-b302-afb409d81aaa 1073741824
Sep 07 18:19:07 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbaa355f-e1dd-41d0-8d7c-161cdc0eae67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:07 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Volume volume-58f54a19-231d-411b-b28c-4d24fa86e586 (58f54a19-231d-411b-b28c-4d24fa86e586): created successfully
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbaa355f-e1dd-41d0-8d7c-161cdc0eae67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Flow 'volume_create_manager' (e5adf688-93d3-4299-acba-00484ca6c5e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:07 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9d13a77f-93fa-45e0-ac59-7a831078d241 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Created volume successfully.
Sep 07 18:19:07 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d2b1b2b8-972c-46dd-8491-af163f7c6cf2 tempest-CreateVolumesFromImageTest-656920226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5f020d9c-f013-4b15-9c92-64b9241372d6" returned: 0 in 0.383s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d2b1b2b8-972c-46dd-8491-af163f7c6cf2 tempest-CreateVolumesFromImageTest-656920226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5f020d9c-f013-4b15-9c92-64b9241372d6 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:07 devstack sudo[105020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5f020d9c-f013-4b15-9c92-64b9241372d6
Sep 07 18:19:07 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:07 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d2b1b2b8-972c-46dd-8491-af163f7c6cf2 tempest-CreateVolumesFromImageTest-656920226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5f020d9c-f013-4b15-9c92-64b9241372d6" returned: 0 in 0.278s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d2b1b2b8-972c-46dd-8491-af163f7c6cf2 tempest-CreateVolumesFromImageTest-656920226 None] Lock "cinder-quobyte-5f020d9c-f013-4b15-9c92-64b9241372d6" released by "delete_volume" :: held 0.711s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-d2b1b2b8-972c-46dd-8491-af163f7c6cf2 tempest-CreateVolumesFromImageTest-656920226 None] Created reservations ['01cf72e3-a80b-4192-adfe-44c01d633e90', '5d974bd3-13b9-40a8-9692-b73a2ad16e2a', '1ed320fe-45af-425f-b82a-500285074e01', '843db8a5-d64c-4c1f-bcf1-371387fd4f7f'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:07 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3473c43a-ab9b-44ee-b302-afb409d81aaa 1073741824" returned: 0 in 0.485s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3473c43a-ab9b-44ee-b302-afb409d81aaa {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d2b1b2b8-972c-46dd-8491-af163f7c6cf2 tempest-CreateVolumesFromImageTest-656920226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d2b1b2b8-972c-46dd-8491-af163f7c6cf2 tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d2b1b2b8-972c-46dd-8491-af163f7c6cf2 tempest-CreateVolumesFromImageTest-656920226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d2b1b2b8-972c-46dd-8491-af163f7c6cf2 tempest-CreateVolumesFromImageTest-656920226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d2b1b2b8-972c-46dd-8491-af163f7c6cf2 tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d2b1b2b8-972c-46dd-8491-af163f7c6cf2 tempest-CreateVolumesFromImageTest-656920226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:07 devstack sudo[105027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3473c43a-ab9b-44ee-b302-afb409d81aaa
Sep 07 18:19:07 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:07 devstack sudo[105028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:19:07 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:07 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:07 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d9fe5442-922f-4773-9511-7170ca3404d8 tempest-CreateVolumesFromImageTest-656920226 None] Acquiring lock "cinder-1fbef953-32db-4f21-ba7d-4e6e115146ec-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d2b1b2b8-972c-46dd-8491-af163f7c6cf2 tempest-CreateVolumesFromImageTest-656920226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.260s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3473c43a-ab9b-44ee-b302-afb409d81aaa" returned: 0 in 0.284s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-d2b1b2b8-972c-46dd-8491-af163f7c6cf2 tempest-CreateVolumesFromImageTest-656920226 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dd0eda62-7864-4ee5-b7d1-6d5f92fc1e2c tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.459s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:07 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d2b1b2b8-972c-46dd-8491-af163f7c6cf2 tempest-CreateVolumesFromImageTest-656920226 None] Deleted volume successfully.
Sep 07 18:19:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d9fe5442-922f-4773-9511-7170ca3404d8 tempest-CreateVolumesFromImageTest-656920226 None] Lock "cinder-1fbef953-32db-4f21-ba7d-4e6e115146ec-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2398375-7f72-49e6-9dd7-e1fd9b9962de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3473c43a-ab9b-44ee-b302-afb409d81aaa', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09782ab-647f-44e1-90a0-fe197e11a88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-dd0eda62-7864-4ee5-b7d1-6d5f92fc1e2c tempest-CreateVolumesFromSnapshotTest-1287138496 None] Creating offline snapshot 916f36cc-37df-437a-862e-225dd461d9c0 of volume edd38f47-f826-4762-a433-bb0ebe6939a8 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:19:08 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Volume volume-3473c43a-ab9b-44ee-b302-afb409d81aaa (3473c43a-ab9b-44ee-b302-afb409d81aaa): created successfully
Sep 07 18:19:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b09782ab-647f-44e1-90a0-fe197e11a88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Flow 'volume_create_manager' (06d3b59f-6592-48e1-bd4e-302f6cb0f790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:08 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ba5c57-998e-434f-a05f-8ae6f2685a4f]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d2b1b2b8-972c-46dd-8491-af163f7c6cf2 tempest-CreateVolumesFromImageTest-656920226 None] Lock "cinder-5f020d9c-f013-4b15-9c92-64b9241372d6-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dd0eda62-7864-4ee5-b7d1-6d5f92fc1e2c tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:08 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b29ebed1-4b4c-424e-8161-909913fc0175 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Created volume successfully.
Sep 07 18:19:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d9fe5442-922f-4773-9511-7170ca3404d8 tempest-CreateVolumesFromImageTest-656920226 None] Acquiring lock "cinder-quobyte-1fbef953-32db-4f21-ba7d-4e6e115146ec" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d9fe5442-922f-4773-9511-7170ca3404d8 tempest-CreateVolumesFromImageTest-656920226 None] Lock "cinder-quobyte-1fbef953-32db-4f21-ba7d-4e6e115146ec" acquired by "delete_volume" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:08 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6381e33d-18fa-43f1-b4a0-d8759b3513e3]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d9fe5442-922f-4773-9511-7170ca3404d8 tempest-CreateVolumesFromImageTest-656920226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fbef953-32db-4f21-ba7d-4e6e115146ec {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:08 devstack sudo[105033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8
Sep 07 18:19:08 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:08 devstack sudo[105034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fbef953-32db-4f21-ba7d-4e6e115146ec
Sep 07 18:19:08 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:08 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dd0eda62-7864-4ee5-b7d1-6d5f92fc1e2c tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8" returned: 0 in 0.370s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dd0eda62-7864-4ee5-b7d1-6d5f92fc1e2c tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8.916f36cc-37df-437a-862e-225dd461d9c0 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:08 devstack sudo[105040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8.916f36cc-37df-437a-862e-225dd461d9c0 1G
Sep 07 18:19:08 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:08 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d9fe5442-922f-4773-9511-7170ca3404d8 tempest-CreateVolumesFromImageTest-656920226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fbef953-32db-4f21-ba7d-4e6e115146ec" returned: 0 in 0.403s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d9fe5442-922f-4773-9511-7170ca3404d8 tempest-CreateVolumesFromImageTest-656920226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fbef953-32db-4f21-ba7d-4e6e115146ec {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:08 devstack sudo[105045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fbef953-32db-4f21-ba7d-4e6e115146ec
Sep 07 18:19:08 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:08 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d9fe5442-922f-4773-9511-7170ca3404d8 tempest-CreateVolumesFromImageTest-656920226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1fbef953-32db-4f21-ba7d-4e6e115146ec" returned: 0 in 0.249s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d9fe5442-922f-4773-9511-7170ca3404d8 tempest-CreateVolumesFromImageTest-656920226 None] Lock "cinder-quobyte-1fbef953-32db-4f21-ba7d-4e6e115146ec" released by "delete_volume" :: held 0.699s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:08 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dd0eda62-7864-4ee5-b7d1-6d5f92fc1e2c tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8.916f36cc-37df-437a-862e-225dd461d9c0 1G" returned: 0 in 0.424s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dd0eda62-7864-4ee5-b7d1-6d5f92fc1e2c tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edd38f47-f826-4762-a433-bb0ebe6939a8 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8.916f36cc-37df-437a-862e-225dd461d9c0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:08 devstack sudo[105051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edd38f47-f826-4762-a433-bb0ebe6939a8 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8.916f36cc-37df-437a-862e-225dd461d9c0
Sep 07 18:19:08 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:08 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-d9fe5442-922f-4773-9511-7170ca3404d8 tempest-CreateVolumesFromImageTest-656920226 None] Created reservations ['eae574b0-ebbc-4dd4-b73b-46bedd7a0334', '0e49a77f-d0f6-481f-92a3-b602d8accf5b', '99cc46cc-8ab1-4f73-90a6-fe612d9b1d67', 'c19a4445-5bda-47b8-a1b6-cc89f56d011d'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d9fe5442-922f-4773-9511-7170ca3404d8 tempest-CreateVolumesFromImageTest-656920226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d9fe5442-922f-4773-9511-7170ca3404d8 tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d9fe5442-922f-4773-9511-7170ca3404d8 tempest-CreateVolumesFromImageTest-656920226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d9fe5442-922f-4773-9511-7170ca3404d8 tempest-CreateVolumesFromImageTest-656920226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d9fe5442-922f-4773-9511-7170ca3404d8 tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d9fe5442-922f-4773-9511-7170ca3404d8 tempest-CreateVolumesFromImageTest-656920226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:09 devstack sudo[105053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:19:09 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-145ebe70-b64e-418d-90ad-51404a25f327 tempest-CreateVolumesFromImageTest-656920226 None] Acquiring lock "cinder-315c3719-26e9-47ae-97b5-eb68e71ad5e4-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-145ebe70-b64e-418d-90ad-51404a25f327 tempest-CreateVolumesFromImageTest-656920226 None] Lock "cinder-315c3719-26e9-47ae-97b5-eb68e71ad5e4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-145ebe70-b64e-418d-90ad-51404a25f327 tempest-CreateVolumesFromImageTest-656920226 None] Acquiring lock "cinder-quobyte-315c3719-26e9-47ae-97b5-eb68e71ad5e4" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-145ebe70-b64e-418d-90ad-51404a25f327 tempest-CreateVolumesFromImageTest-656920226 None] Lock "cinder-quobyte-315c3719-26e9-47ae-97b5-eb68e71ad5e4" acquired by "delete_volume" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:09 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2aca014-b110-4229-a0c6-1bf0a7668a20]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-145ebe70-b64e-418d-90ad-51404a25f327 tempest-CreateVolumesFromImageTest-656920226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-315c3719-26e9-47ae-97b5-eb68e71ad5e4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:09 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dd0eda62-7864-4ee5-b7d1-6d5f92fc1e2c tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edd38f47-f826-4762-a433-bb0ebe6939a8 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8.916f36cc-37df-437a-862e-225dd461d9c0" returned: 0 in 0.354s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:09 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-dd0eda62-7864-4ee5-b7d1-6d5f92fc1e2c tempest-CreateVolumesFromSnapshotTest-1287138496 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8.916f36cc-37df-437a-862e-225dd461d9c0 is being set with open permissions: ugo+rw
Sep 07 18:19:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dd0eda62-7864-4ee5-b7d1-6d5f92fc1e2c tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8.916f36cc-37df-437a-862e-225dd461d9c0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:09 devstack sudo[105059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8.916f36cc-37df-437a-862e-225dd461d9c0
Sep 07 18:19:09 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:09 devstack sudo[105058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-315c3719-26e9-47ae-97b5-eb68e71ad5e4
Sep 07 18:19:09 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:09 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d9fe5442-922f-4773-9511-7170ca3404d8 tempest-CreateVolumesFromImageTest-656920226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.295s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:09 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-d9fe5442-922f-4773-9511-7170ca3404d8 tempest-CreateVolumesFromImageTest-656920226 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:19:09 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d9fe5442-922f-4773-9511-7170ca3404d8 tempest-CreateVolumesFromImageTest-656920226 None] Deleted volume successfully.
Sep 07 18:19:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d9fe5442-922f-4773-9511-7170ca3404d8 tempest-CreateVolumesFromImageTest-656920226 None] Lock "cinder-1fbef953-32db-4f21-ba7d-4e6e115146ec-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:09 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dd0eda62-7864-4ee5-b7d1-6d5f92fc1e2c tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8.916f36cc-37df-437a-862e-225dd461d9c0" returned: 0 in 0.254s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dd0eda62-7864-4ee5-b7d1-6d5f92fc1e2c tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:09 devstack sudo[105066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8.info
Sep 07 18:19:09 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:09 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-145ebe70-b64e-418d-90ad-51404a25f327 tempest-CreateVolumesFromImageTest-656920226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-315c3719-26e9-47ae-97b5-eb68e71ad5e4" returned: 0 in 0.393s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-145ebe70-b64e-418d-90ad-51404a25f327 tempest-CreateVolumesFromImageTest-656920226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-315c3719-26e9-47ae-97b5-eb68e71ad5e4 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:09 devstack sudo[105069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-315c3719-26e9-47ae-97b5-eb68e71ad5e4
Sep 07 18:19:09 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:09 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dd0eda62-7864-4ee5-b7d1-6d5f92fc1e2c tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8.info" returned: 0 in 0.273s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:09 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-dd0eda62-7864-4ee5-b7d1-6d5f92fc1e2c tempest-CreateVolumesFromSnapshotTest-1287138496 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8.info is being set with open permissions: ugo+rw
Sep 07 18:19:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dd0eda62-7864-4ee5-b7d1-6d5f92fc1e2c tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:09 devstack sudo[105074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8.info
Sep 07 18:19:09 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:09 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-145ebe70-b64e-418d-90ad-51404a25f327 tempest-CreateVolumesFromImageTest-656920226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-315c3719-26e9-47ae-97b5-eb68e71ad5e4" returned: 0 in 0.280s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-145ebe70-b64e-418d-90ad-51404a25f327 tempest-CreateVolumesFromImageTest-656920226 None] Lock "cinder-quobyte-315c3719-26e9-47ae-97b5-eb68e71ad5e4" released by "delete_volume" :: held 0.715s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-145ebe70-b64e-418d-90ad-51404a25f327 tempest-CreateVolumesFromImageTest-656920226 None] Created reservations ['60759dbc-6575-4b91-970d-9dde244cd014', '98e9a588-e4f6-4763-b854-157ef092f6b5', '72026b0c-08dd-45d2-adc4-54605bbc9af3', 'c1a169ff-cc8f-428c-b71f-15d114dd6389'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-145ebe70-b64e-418d-90ad-51404a25f327 tempest-CreateVolumesFromImageTest-656920226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-145ebe70-b64e-418d-90ad-51404a25f327 tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-145ebe70-b64e-418d-90ad-51404a25f327 tempest-CreateVolumesFromImageTest-656920226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-145ebe70-b64e-418d-90ad-51404a25f327 tempest-CreateVolumesFromImageTest-656920226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-145ebe70-b64e-418d-90ad-51404a25f327 tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-145ebe70-b64e-418d-90ad-51404a25f327 tempest-CreateVolumesFromImageTest-656920226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:10 devstack sudo[105110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:19:10 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:10 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dd0eda62-7864-4ee5-b7d1-6d5f92fc1e2c tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8.info" returned: 0 in 0.294s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dd0eda62-7864-4ee5-b7d1-6d5f92fc1e2c tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.170s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.527s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1331926644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cf32c7d-fcc2-4930-bebb-371e238f3f0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb2adf969434a4a8d3a1fb194394ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:03Z,use_quota=True,user_id='d1fe744f24a24f18b3a073dc44e54db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Creating volume 6cf32c7d-fcc2-4930-bebb-371e238f3f0e {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:19:10 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6cf32c7d-fcc2-4930-bebb-371e238f3f0e 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:10 devstack sudo[105114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6cf32c7d-fcc2-4930-bebb-371e238f3f0e 1073741824
Sep 07 18:19:10 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:10 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-dd0eda62-7864-4ee5-b7d1-6d5f92fc1e2c tempest-CreateVolumesFromSnapshotTest-1287138496 None] Create snapshot completed successfully
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5c9fcdee-338c-47d9-99bf-71622f4a7105 tempest-CreateVolumesFromImageTest-656920226 None] Acquiring lock "cinder-fc38c657-a996-4556-afe8-e0af4ece341e-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5c9fcdee-338c-47d9-99bf-71622f4a7105 tempest-CreateVolumesFromImageTest-656920226 None] Lock "cinder-fc38c657-a996-4556-afe8-e0af4ece341e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:10 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-145ebe70-b64e-418d-90ad-51404a25f327 tempest-CreateVolumesFromImageTest-656920226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.314s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-145ebe70-b64e-418d-90ad-51404a25f327 tempest-CreateVolumesFromImageTest-656920226 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:19:10 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-145ebe70-b64e-418d-90ad-51404a25f327 tempest-CreateVolumesFromImageTest-656920226 None] Deleted volume successfully.
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5c9fcdee-338c-47d9-99bf-71622f4a7105 tempest-CreateVolumesFromImageTest-656920226 None] Acquiring lock "cinder-quobyte-fc38c657-a996-4556-afe8-e0af4ece341e" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-145ebe70-b64e-418d-90ad-51404a25f327 tempest-CreateVolumesFromImageTest-656920226 None] Lock "cinder-315c3719-26e9-47ae-97b5-eb68e71ad5e4-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5c9fcdee-338c-47d9-99bf-71622f4a7105 tempest-CreateVolumesFromImageTest-656920226 None] Lock "cinder-quobyte-fc38c657-a996-4556-afe8-e0af4ece341e" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d36d55d-8f9d-4178-8724-88e064e5e5ab]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5c9fcdee-338c-47d9-99bf-71622f4a7105 tempest-CreateVolumesFromImageTest-656920226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fc38c657-a996-4556-afe8-e0af4ece341e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:10 devstack sudo[105119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fc38c657-a996-4556-afe8-e0af4ece341e
Sep 07 18:19:10 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:10 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6cf32c7d-fcc2-4930-bebb-371e238f3f0e 1073741824" returned: 0 in 0.605s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6cf32c7d-fcc2-4930-bebb-371e238f3f0e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:10 devstack sudo[105125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6cf32c7d-fcc2-4930-bebb-371e238f3f0e
Sep 07 18:19:10 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:10 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5c9fcdee-338c-47d9-99bf-71622f4a7105 tempest-CreateVolumesFromImageTest-656920226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fc38c657-a996-4556-afe8-e0af4ece341e" returned: 0 in 0.467s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5c9fcdee-338c-47d9-99bf-71622f4a7105 tempest-CreateVolumesFromImageTest-656920226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fc38c657-a996-4556-afe8-e0af4ece341e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:10 devstack sudo[105128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fc38c657-a996-4556-afe8-e0af4ece341e
Sep 07 18:19:10 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Flow 'volume_create_manager' (48010686-f889-4650-bb93-c1697fead133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ab2fce-bfa9-4a9c-93fc-c5d0db485a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:11 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3ab2fce-bfa9-4a9c-93fc-c5d0db485a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-444370183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28061f8b-b735-4dc8-9cef-ac0aa8f0d56f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5466302516254de09e6ea7b13e12e04b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:11Z,use_quota=True,user_id='2ae88396d75b4c43b3d3317bb3d21af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bce3821-ff50-450a-9c7d-f429dd54673b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bce3821-ff50-450a-9c7d-f429dd54673b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b5e9b3-6c42-4c8e-847c-e2ae4f2d12e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53b5e9b3-6c42-4c8e-847c-e2ae4f2d12e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28061f8b-b735-4dc8-9cef-ac0aa8f0d56f', 'volume_name': 'volume-28061f8b-b735-4dc8-9cef-ac0aa8f0d56f', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e88156-606b-4534-9efb-ad41858bec55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e88156-606b-4534-9efb-ad41858bec55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2891be75-847f-4bb1-83c8-920d68f40420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:11 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Volume 28061f8b-b735-4dc8-9cef-ac0aa8f0d56f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28061f8b-b735-4dc8-9cef-ac0aa8f0d56f', 'volume_size': 1}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6cf32c7d-fcc2-4930-bebb-371e238f3f0e" returned: 0 in 0.363s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.145s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1172733077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b8c741-209c-4af5-b9e2-753dab4bd3bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb2adf969434a4a8d3a1fb194394ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:04Z,use_quota=True,user_id='d1fe744f24a24f18b3a073dc44e54db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Creating volume 81b8c741-209c-4af5-b9e2-753dab4bd3bc {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:19:11 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-81b8c741-209c-4af5-b9e2-753dab4bd3bc 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98c8e3f1-7406-436b-b803-403dc41260c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cf32c7d-fcc2-4930-bebb-371e238f3f0e', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:11 devstack sudo[105132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-81b8c741-209c-4af5-b9e2-753dab4bd3bc 1073741824
Sep 07 18:19:11 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ac73db-6821-4634-99fa-b155054f7d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:11 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Volume volume-6cf32c7d-fcc2-4930-bebb-371e238f3f0e (6cf32c7d-fcc2-4930-bebb-371e238f3f0e): created successfully
Sep 07 18:19:11 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ac73db-6821-4634-99fa-b155054f7d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Flow 'volume_create_manager' (4811e166-58c6-49b8-92a2-db26dd1db779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5c9fcdee-338c-47d9-99bf-71622f4a7105 tempest-CreateVolumesFromImageTest-656920226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-fc38c657-a996-4556-afe8-e0af4ece341e" returned: 0 in 0.345s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5c9fcdee-338c-47d9-99bf-71622f4a7105 tempest-CreateVolumesFromImageTest-656920226 None] Lock "cinder-quobyte-fc38c657-a996-4556-afe8-e0af4ece341e" released by "delete_volume" :: held 0.858s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:11 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-1eb84cba-f0d6-43ae-8c49-3f04777ba711 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Created volume successfully.
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-5c9fcdee-338c-47d9-99bf-71622f4a7105 tempest-CreateVolumesFromImageTest-656920226 None] Created reservations ['39490328-92ce-44ce-9593-ebc02c4ec700', '7a6901a3-3be1-46c4-84ae-479708bcd095', 'd11adee7-2054-4970-8a6b-ade48cfa1853', '175c956f-7958-4e13-83f9-62dd81fc8020'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5c9fcdee-338c-47d9-99bf-71622f4a7105 tempest-CreateVolumesFromImageTest-656920226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5c9fcdee-338c-47d9-99bf-71622f4a7105 tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5c9fcdee-338c-47d9-99bf-71622f4a7105 tempest-CreateVolumesFromImageTest-656920226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-5c9fcdee-338c-47d9-99bf-71622f4a7105 tempest-CreateVolumesFromImageTest-656920226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-5c9fcdee-338c-47d9-99bf-71622f4a7105 tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5c9fcdee-338c-47d9-99bf-71622f4a7105 tempest-CreateVolumesFromImageTest-656920226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:11 devstack sudo[105134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:19:11 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ec678974-f839-4ebe-bfbf-61452ca66076 tempest-CreateVolumesFromImageTest-656920226 None] Acquiring lock "cinder-b2976b47-bd91-47fa-a79b-fa7f8b529a7b-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Flow 'volume_create_manager' (511458e5-45de-471b-85c4-fae654f8d387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd33036f-bd6d-4ec5-b3cd-48100d7efc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ec678974-f839-4ebe-bfbf-61452ca66076 tempest-CreateVolumesFromImageTest-656920226 None] Lock "cinder-b2976b47-bd91-47fa-a79b-fa7f8b529a7b-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd33036f-bd6d-4ec5-b3cd-48100d7efc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1863059592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6386eca-a875-4748-82f1-e0407dd994cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5466302516254de09e6ea7b13e12e04b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:12Z,use_quota=True,user_id='2ae88396d75b4c43b3d3317bb3d21af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb77ce0-b077-4652-84c6-67dac344bc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb77ce0-b077-4652-84c6-67dac344bc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e26cd2-916f-4efb-9d37-423e4343cf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e26cd2-916f-4efb-9d37-423e4343cf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6386eca-a875-4748-82f1-e0407dd994cc', 'volume_name': 'volume-d6386eca-a875-4748-82f1-e0407dd994cc', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a76b39-3b5e-4494-bac6-38954b75522c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a76b39-3b5e-4494-bac6-38954b75522c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc055a46-39cd-4a74-8498-9062e85794e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:11 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Volume d6386eca-a875-4748-82f1-e0407dd994cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6386eca-a875-4748-82f1-e0407dd994cc', 'volume_size': 1}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ec678974-f839-4ebe-bfbf-61452ca66076 tempest-CreateVolumesFromImageTest-656920226 None] Acquiring lock "cinder-quobyte-b2976b47-bd91-47fa-a79b-fa7f8b529a7b" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:11 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-81b8c741-209c-4af5-b9e2-753dab4bd3bc 1073741824" returned: 0 in 0.610s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ec678974-f839-4ebe-bfbf-61452ca66076 tempest-CreateVolumesFromImageTest-656920226 None] Lock "cinder-quobyte-b2976b47-bd91-47fa-a79b-fa7f8b529a7b" acquired by "delete_volume" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf70144-8c6f-4259-bb7a-ce64d6734c3c]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ec678974-f839-4ebe-bfbf-61452ca66076 tempest-CreateVolumesFromImageTest-656920226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b2976b47-bd91-47fa-a79b-fa7f8b529a7b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:11 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-5c9fcdee-338c-47d9-99bf-71622f4a7105 tempest-CreateVolumesFromImageTest-656920226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.465s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-5c9fcdee-338c-47d9-99bf-71622f4a7105 tempest-CreateVolumesFromImageTest-656920226 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:19:11 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-5c9fcdee-338c-47d9-99bf-71622f4a7105 tempest-CreateVolumesFromImageTest-656920226 None] Deleted volume successfully.
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-81b8c741-209c-4af5-b9e2-753dab4bd3bc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-5c9fcdee-338c-47d9-99bf-71622f4a7105 tempest-CreateVolumesFromImageTest-656920226 None] Lock "cinder-fc38c657-a996-4556-afe8-e0af4ece341e-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:12 devstack sudo[105142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-81b8c741-209c-4af5-b9e2-753dab4bd3bc
Sep 07 18:19:12 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:12 devstack sudo[105141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b2976b47-bd91-47fa-a79b-fa7f8b529a7b
Sep 07 18:19:12 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Flow 'volume_create_manager' (f7719b16-08f5-4d20-8569-71b0ca217186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae637fa7-f6f8-422c-8ab9-b7804872d265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae637fa7-f6f8-422c-8ab9-b7804872d265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1551735318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afbaa6d1-ec29-4585-a881-557a6ad612f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5466302516254de09e6ea7b13e12e04b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:12Z,use_quota=True,user_id='2ae88396d75b4c43b3d3317bb3d21af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b166a0-d027-4a5c-b0dd-1523e55b3662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65b166a0-d027-4a5c-b0dd-1523e55b3662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469d6690-eb7a-4829-8aa0-02e836c6f937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469d6690-eb7a-4829-8aa0-02e836c6f937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afbaa6d1-ec29-4585-a881-557a6ad612f2', 'volume_name': 'volume-afbaa6d1-ec29-4585-a881-557a6ad612f2', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:12 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d55a75-d7a3-479a-9407-901e3af8f7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d55a75-d7a3-479a-9407-901e3af8f7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5ecd35-a92d-44e8-84f4-04365eb2bf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:12 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Volume afbaa6d1-ec29-4585-a881-557a6ad612f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afbaa6d1-ec29-4585-a881-557a6ad612f2', 'volume_size': 1}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-81b8c741-209c-4af5-b9e2-753dab4bd3bc" returned: 0 in 0.313s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.608s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1596072563',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cca7252-88e4-47d4-8539-dcc4ec522ed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb2adf969434a4a8d3a1fb194394ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:04Z,use_quota=True,user_id='d1fe744f24a24f18b3a073dc44e54db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Creating volume 5cca7252-88e4-47d4-8539-dcc4ec522ed9 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:19:12 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5cca7252-88e4-47d4-8539-dcc4ec522ed9 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c5b0f3-77d2-47d8-9ef3-0b343a784ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81b8c741-209c-4af5-b9e2-753dab4bd3bc', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042b27c4-9106-4548-99a6-73831c7fe31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:12 devstack sudo[105148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5cca7252-88e4-47d4-8539-dcc4ec522ed9 1073741824
Sep 07 18:19:12 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:12 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Volume volume-81b8c741-209c-4af5-b9e2-753dab4bd3bc (81b8c741-209c-4af5-b9e2-753dab4bd3bc): created successfully
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042b27c4-9106-4548-99a6-73831c7fe31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Flow 'volume_create_manager' (9ff41431-1478-4f61-9cd4-24c1bdf41c13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:12 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4401a1c7-95ef-463b-aa81-463ff837ff97 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Created volume successfully.
Sep 07 18:19:12 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ec678974-f839-4ebe-bfbf-61452ca66076 tempest-CreateVolumesFromImageTest-656920226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b2976b47-bd91-47fa-a79b-fa7f8b529a7b" returned: 0 in 0.503s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ec678974-f839-4ebe-bfbf-61452ca66076 tempest-CreateVolumesFromImageTest-656920226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b2976b47-bd91-47fa-a79b-fa7f8b529a7b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:12 devstack sudo[105151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b2976b47-bd91-47fa-a79b-fa7f8b529a7b
Sep 07 18:19:12 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Flow 'volume_create_manager' (07d6b641-a322-43e3-8766-50cb5a1eddbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94a373b-d6c2-4f2d-9617-c692a3ed373c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94a373b-d6c2-4f2d-9617-c692a3ed373c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1319454897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79b90ff1-6de2-42ef-ac95-64bd1b8c658d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5466302516254de09e6ea7b13e12e04b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:13Z,use_quota=True,user_id='2ae88396d75b4c43b3d3317bb3d21af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994541e8-a853-4c89-a2e9-0e065828746f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994541e8-a853-4c89-a2e9-0e065828746f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f96caf2-70e7-4cc7-8477-8178b4cab001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f96caf2-70e7-4cc7-8477-8178b4cab001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79b90ff1-6de2-42ef-ac95-64bd1b8c658d', 'volume_name': 'volume-79b90ff1-6de2-42ef-ac95-64bd1b8c658d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03ddd90-c96e-43cf-ab5b-d0171284ef71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03ddd90-c96e-43cf-ab5b-d0171284ef71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff2c8e9f-ed3c-4f46-a757-2de430ce94ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:12 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Volume 79b90ff1-6de2-42ef-ac95-64bd1b8c658d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79b90ff1-6de2-42ef-ac95-64bd1b8c658d', 'volume_size': 1}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:12 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ec678974-f839-4ebe-bfbf-61452ca66076 tempest-CreateVolumesFromImageTest-656920226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-b2976b47-bd91-47fa-a79b-fa7f8b529a7b" returned: 0 in 0.343s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ec678974-f839-4ebe-bfbf-61452ca66076 tempest-CreateVolumesFromImageTest-656920226 None] Lock "cinder-quobyte-b2976b47-bd91-47fa-a79b-fa7f8b529a7b" released by "delete_volume" :: held 0.923s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:12 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5cca7252-88e4-47d4-8539-dcc4ec522ed9 1073741824" returned: 0 in 0.539s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-ec678974-f839-4ebe-bfbf-61452ca66076 tempest-CreateVolumesFromImageTest-656920226 None] Created reservations ['e69457e0-1729-4895-90c5-1f31274b7d6b', '731f5eef-1dac-4aef-a5c4-dd67715acdc1', '248b596a-7c07-4f5c-a84a-833f1825e5fb', '27ec4aa3-48ac-459c-ba47-b17ff5449b63'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5cca7252-88e4-47d4-8539-dcc4ec522ed9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:12 devstack sudo[105158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5cca7252-88e4-47d4-8539-dcc4ec522ed9
Sep 07 18:19:12 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ec678974-f839-4ebe-bfbf-61452ca66076 tempest-CreateVolumesFromImageTest-656920226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ec678974-f839-4ebe-bfbf-61452ca66076 tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ec678974-f839-4ebe-bfbf-61452ca66076 tempest-CreateVolumesFromImageTest-656920226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ec678974-f839-4ebe-bfbf-61452ca66076 tempest-CreateVolumesFromImageTest-656920226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ec678974-f839-4ebe-bfbf-61452ca66076 tempest-CreateVolumesFromImageTest-656920226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ec678974-f839-4ebe-bfbf-61452ca66076 tempest-CreateVolumesFromImageTest-656920226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:12 devstack sudo[105160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:19:12 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Flow 'volume_create_manager' (168101f9-0a5a-47e5-830c-eeedab439e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99260330-821b-4c62-90ed-9aa41a97fdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99260330-821b-4c62-90ed-9aa41a97fdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2085211127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05bc84ba-8bbd-4221-b890-837ecd2d32ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5466302516254de09e6ea7b13e12e04b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:13Z,use_quota=True,user_id='2ae88396d75b4c43b3d3317bb3d21af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be539126-c7f4-4122-a2a9-13a914d6acef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be539126-c7f4-4122-a2a9-13a914d6acef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe27c8b-a89c-4799-ad75-5185d0d0392a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe27c8b-a89c-4799-ad75-5185d0d0392a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05bc84ba-8bbd-4221-b890-837ecd2d32ad', 'volume_name': 'volume-05bc84ba-8bbd-4221-b890-837ecd2d32ad', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1903fd0-2eed-45bf-a403-2c03170ab9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1903fd0-2eed-45bf-a403-2c03170ab9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4f2fb6-72bd-4c22-8d47-8ee4b77dc851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:13 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Volume 05bc84ba-8bbd-4221-b890-837ecd2d32ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05bc84ba-8bbd-4221-b890-837ecd2d32ad', 'volume_size': 1}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:13 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5cca7252-88e4-47d4-8539-dcc4ec522ed9" returned: 0 in 0.304s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.563s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c62783-0d55-4d48-b9b8-0f12505ef625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d94f780c26c04483843c9a74e44cc557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:05Z,use_quota=True,user_id='a33567c60beb4403bdc0a8ec1e7c8222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3256b1d0-53a9-47b3-89a8-9b93ab2fc48a),volume_type_id=3256b1d0-53a9-47b3-89a8-9b93ab2fc48a)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Creating volume d5c62783-0d55-4d48-b9b8-0f12505ef625 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:19:13 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d5c62783-0d55-4d48-b9b8-0f12505ef625 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1009f7c-b770-46f9-829b-6e02deb433be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cca7252-88e4-47d4-8539-dcc4ec522ed9', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (571ed6a3-de5c-46b6-9dc2-1aa946c24d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:13 devstack sudo[105164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d5c62783-0d55-4d48-b9b8-0f12505ef625 1073741824
Sep 07 18:19:13 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:13 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ec678974-f839-4ebe-bfbf-61452ca66076 tempest-CreateVolumesFromImageTest-656920226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.282s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-ec678974-f839-4ebe-bfbf-61452ca66076 tempest-CreateVolumesFromImageTest-656920226 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:19:13 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ec678974-f839-4ebe-bfbf-61452ca66076 tempest-CreateVolumesFromImageTest-656920226 None] Deleted volume successfully.
Sep 07 18:19:13 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Volume volume-5cca7252-88e4-47d4-8539-dcc4ec522ed9 (5cca7252-88e4-47d4-8539-dcc4ec522ed9): created successfully
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (571ed6a3-de5c-46b6-9dc2-1aa946c24d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Flow 'volume_create_manager' (fd76599b-4e3b-4d9d-9eaf-1ded770ebd7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:13 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-775b43f7-9a4b-4943-8ec0-3ee2c484abc1 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Created volume successfully.
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ec678974-f839-4ebe-bfbf-61452ca66076 tempest-CreateVolumesFromImageTest-656920226 None] Lock "cinder-b2976b47-bd91-47fa-a79b-fa7f8b529a7b-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:13 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d5c62783-0d55-4d48-b9b8-0f12505ef625 1073741824" returned: 0 in 0.422s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d5c62783-0d55-4d48-b9b8-0f12505ef625 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:13 devstack sudo[105170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d5c62783-0d55-4d48-b9b8-0f12505ef625
Sep 07 18:19:13 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:13 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d5c62783-0d55-4d48-b9b8-0f12505ef625" returned: 0 in 0.281s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.743s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-444370183',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28061f8b-b735-4dc8-9cef-ac0aa8f0d56f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5466302516254de09e6ea7b13e12e04b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:11Z,use_quota=True,user_id='2ae88396d75b4c43b3d3317bb3d21af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Creating volume 28061f8b-b735-4dc8-9cef-ac0aa8f0d56f {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:19:13 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:19:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28061f8b-b735-4dc8-9cef-ac0aa8f0d56f 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:14 devstack sudo[105173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28061f8b-b735-4dc8-9cef-ac0aa8f0d56f 1073741824
Sep 07 18:19:14 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Attempting download of 2a3554da-9b18-4c8d-a64f-2c347560b016 ((None, [{'url': 'file:///opt/stack/data/glance/images/2a3554da-9b18-4c8d-a64f-2c347560b016', 'metadata': {}}])) to volume d5c62783-0d55-4d48-b9b8-0f12505ef625. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae7437f-c16c-4565-96f7-0153cf11dbee]: (4, 'raw') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2a3554da-9b18-4c8d-a64f-2c347560b016_0g27ir0f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:14 devstack sudo[105175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2a3554da-9b18-4c8d-a64f-2c347560b016_0g27ir0f
Sep 07 18:19:14 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c8884abd-51a2-46ca-8a5c-fbc0860f8b57 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "cinder-5cca7252-88e4-47d4-8539-dcc4ec522ed9-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c8884abd-51a2-46ca-8a5c-fbc0860f8b57 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "cinder-5cca7252-88e4-47d4-8539-dcc4ec522ed9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c8884abd-51a2-46ca-8a5c-fbc0860f8b57 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "cinder-quobyte-5cca7252-88e4-47d4-8539-dcc4ec522ed9" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c8884abd-51a2-46ca-8a5c-fbc0860f8b57 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "cinder-quobyte-5cca7252-88e4-47d4-8539-dcc4ec522ed9" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:14 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2a3554da-9b18-4c8d-a64f-2c347560b016_0g27ir0f" returned: 0 in 0.386s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a3554da-9b18-4c8d-a64f-2c347560b016_0g27ir0f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaaf4214-8a00-46e5-b594-3ffb4bb36992]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c8884abd-51a2-46ca-8a5c-fbc0860f8b57 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5cca7252-88e4-47d4-8539-dcc4ec522ed9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:14 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28061f8b-b735-4dc8-9cef-ac0aa8f0d56f 1073741824" returned: 0 in 0.595s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28061f8b-b735-4dc8-9cef-ac0aa8f0d56f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:14 devstack sudo[105184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5cca7252-88e4-47d4-8539-dcc4ec522ed9
Sep 07 18:19:14 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:14 devstack sudo[105185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28061f8b-b735-4dc8-9cef-ac0aa8f0d56f
Sep 07 18:19:14 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:14 devstack sudo[105183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a3554da-9b18-4c8d-a64f-2c347560b016_0g27ir0f
Sep 07 18:19:14 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:14 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a3554da-9b18-4c8d-a64f-2c347560b016_0g27ir0f" returned: 1 in 0.407s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a3554da-9b18-4c8d-a64f-2c347560b016_0g27ir0f' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[368bc46b-9aca-4069-bcc7-286247ad59b3]: (4, 'raw') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a3554da-9b18-4c8d-a64f-2c347560b016_jlctjqdbdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:14 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28061f8b-b735-4dc8-9cef-ac0aa8f0d56f" returned: 0 in 0.327s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.138s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1863059592',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6386eca-a875-4748-82f1-e0407dd994cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5466302516254de09e6ea7b13e12e04b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:12Z,use_quota=True,user_id='2ae88396d75b4c43b3d3317bb3d21af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Creating volume d6386eca-a875-4748-82f1-e0407dd994cc {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:19:14 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d6386eca-a875-4748-82f1-e0407dd994cc 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:14 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c8884abd-51a2-46ca-8a5c-fbc0860f8b57 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5cca7252-88e4-47d4-8539-dcc4ec522ed9" returned: 0 in 0.467s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c8884abd-51a2-46ca-8a5c-fbc0860f8b57 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5cca7252-88e4-47d4-8539-dcc4ec522ed9 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:14 devstack sudo[105197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d6386eca-a875-4748-82f1-e0407dd994cc 1073741824
Sep 07 18:19:14 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2891be75-847f-4bb1-83c8-920d68f40420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28061f8b-b735-4dc8-9cef-ac0aa8f0d56f', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:14 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fcb6f59-029b-4682-a2f5-8f21174cd3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:15 devstack sudo[105198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5cca7252-88e4-47d4-8539-dcc4ec522ed9
Sep 07 18:19:15 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:15 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Volume volume-28061f8b-b735-4dc8-9cef-ac0aa8f0d56f (28061f8b-b735-4dc8-9cef-ac0aa8f0d56f): created successfully
Sep 07 18:19:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fcb6f59-029b-4682-a2f5-8f21174cd3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:15 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Flow 'volume_create_manager' (48010686-f889-4650-bb93-c1697fead133) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:15 devstack sudo[105195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a3554da-9b18-4c8d-a64f-2c347560b016_jlctjqdbdevstack@QuobyteHD
Sep 07 18:19:15 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:15 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9231e55a-bfda-4e82-b339-dd8f135dcd25 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Created volume successfully.
Sep 07 18:19:15 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:15 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c8884abd-51a2-46ca-8a5c-fbc0860f8b57 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-5cca7252-88e4-47d4-8539-dcc4ec522ed9" returned: 0 in 0.402s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a3554da-9b18-4c8d-a64f-2c347560b016_jlctjqdbdevstack@QuobyteHD" returned: 0 in 0.485s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a3554da-9b18-4c8d-a64f-2c347560b016_jlctjqdbdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c8884abd-51a2-46ca-8a5c-fbc0860f8b57 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "cinder-quobyte-5cca7252-88e4-47d4-8539-dcc4ec522ed9" released by "delete_volume" :: held 0.934s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:15 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-c8884abd-51a2-46ca-8a5c-fbc0860f8b57 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Created reservations ['93738d6a-efc6-47c8-8efb-1a40cbb91b21', '78bda325-f838-444e-943e-2fb9291f3efd', '2c78305d-2b5a-46e0-9763-4970e61e1d76', 'dfc15e73-fc0b-4fcb-8e9f-268f5024ea43'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:15 devstack sudo[105209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a3554da-9b18-4c8d-a64f-2c347560b016_jlctjqdbdevstack@QuobyteHD
Sep 07 18:19:15 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c8884abd-51a2-46ca-8a5c-fbc0860f8b57 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c8884abd-51a2-46ca-8a5c-fbc0860f8b57 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c8884abd-51a2-46ca-8a5c-fbc0860f8b57 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c8884abd-51a2-46ca-8a5c-fbc0860f8b57 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c8884abd-51a2-46ca-8a5c-fbc0860f8b57 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c8884abd-51a2-46ca-8a5c-fbc0860f8b57 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:15 devstack sudo[105211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:19:15 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:15 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d6386eca-a875-4748-82f1-e0407dd994cc 1073741824" returned: 0 in 0.696s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d6386eca-a875-4748-82f1-e0407dd994cc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:15 devstack sudo[105213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d6386eca-a875-4748-82f1-e0407dd994cc
Sep 07 18:19:15 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:15 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a3554da-9b18-4c8d-a64f-2c347560b016_jlctjqdbdevstack@QuobyteHD" returned: 1 in 0.399s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a3554da-9b18-4c8d-a64f-2c347560b016_jlctjqdbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 07 18:19:15 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] 2a3554da-9b18-4c8d-a64f-2c347560b016 was raw, converting to qcow2 {{(pid=87269) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 07 18:19:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2a3554da-9b18-4c8d-a64f-2c347560b016_jlctjqdbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d5c62783-0d55-4d48-b9b8-0f12505ef625 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:15 devstack sudo[105218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2a3554da-9b18-4c8d-a64f-2c347560b016_jlctjqdbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d5c62783-0d55-4d48-b9b8-0f12505ef625
Sep 07 18:19:15 devstack sudo[105218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:15 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c8884abd-51a2-46ca-8a5c-fbc0860f8b57 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.307s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:15 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-c8884abd-51a2-46ca-8a5c-fbc0860f8b57 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:19:15 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-c8884abd-51a2-46ca-8a5c-fbc0860f8b57 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Deleted volume successfully.
Sep 07 18:19:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c8884abd-51a2-46ca-8a5c-fbc0860f8b57 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "cinder-5cca7252-88e4-47d4-8539-dcc4ec522ed9-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:15 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d6386eca-a875-4748-82f1-e0407dd994cc" returned: 0 in 0.312s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:19:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.745s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1551735318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afbaa6d1-ec29-4585-a881-557a6ad612f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5466302516254de09e6ea7b13e12e04b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:12Z,use_quota=True,user_id='2ae88396d75b4c43b3d3317bb3d21af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Creating volume afbaa6d1-ec29-4585-a881-557a6ad612f2 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:19:16 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-afbaa6d1-ec29-4585-a881-557a6ad612f2 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc055a46-39cd-4a74-8498-9062e85794e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6386eca-a875-4748-82f1-e0407dd994cc', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:16 devstack sudo[105223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-afbaa6d1-ec29-4585-a881-557a6ad612f2 1073741824
Sep 07 18:19:16 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d867e03-a779-403b-9651-b59e00825162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:16 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Volume volume-d6386eca-a875-4748-82f1-e0407dd994cc (d6386eca-a875-4748-82f1-e0407dd994cc): created successfully
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d867e03-a779-403b-9651-b59e00825162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Flow 'volume_create_manager' (511458e5-45de-471b-85c4-fae654f8d387) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:16 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-761134ab-ec26-4a81-bd27-a5723421f002 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Created volume successfully.
Sep 07 18:19:16 devstack sudo[105218]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2a3554da-9b18-4c8d-a64f-2c347560b016_jlctjqdbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d5c62783-0d55-4d48-b9b8-0f12505ef625" returned: 0 in 0.539s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2a3554da-9b18-4c8d-a64f-2c347560b016_jlctjqdbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d5c62783-0d55-4d48-b9b8-0f12505ef625 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 07 18:19:16 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Converted 0.00 MB image at 0.00 MB/s
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d5c62783-0d55-4d48-b9b8-0f12505ef625 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:16 devstack sudo[105231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d5c62783-0d55-4d48-b9b8-0f12505ef625 1G
Sep 07 18:19:16 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:16 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-afbaa6d1-ec29-4585-a881-557a6ad612f2 1073741824" returned: 0 in 0.530s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-afbaa6d1-ec29-4585-a881-557a6ad612f2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:16 devstack sudo[105237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-afbaa6d1-ec29-4585-a881-557a6ad612f2
Sep 07 18:19:16 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b27cc89c-cbbc-41b4-bb7e-fbed1432f402 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "cinder-81b8c741-209c-4af5-b9e2-753dab4bd3bc-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b27cc89c-cbbc-41b4-bb7e-fbed1432f402 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "cinder-81b8c741-209c-4af5-b9e2-753dab4bd3bc-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:16 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d5c62783-0d55-4d48-b9b8-0f12505ef625 1G" returned: 0 in 0.403s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Downloaded image 2a3554da-9b18-4c8d-a64f-2c347560b016 ((None, [{'url': 'file:///opt/stack/data/glance/images/2a3554da-9b18-4c8d-a64f-2c347560b016', 'metadata': {}}])) to volume d5c62783-0d55-4d48-b9b8-0f12505ef625 successfully. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Temporary image 2a3554da-9b18-4c8d-a64f-2c347560b016 for user a33567c60beb4403bdc0a8ec1e7c8222 is deleted. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Marking volume d5c62783-0d55-4d48-b9b8-0f12505ef625 as bootable. {{(pid=87269) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b27cc89c-cbbc-41b4-bb7e-fbed1432f402 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "cinder-quobyte-81b8c741-209c-4af5-b9e2-753dab4bd3bc" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Copying metadata from image 2a3554da-9b18-4c8d-a64f-2c347560b016 to d5c62783-0d55-4d48-b9b8-0f12505ef625. {{(pid=87269) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Creating volume glance metadata for volume d5c62783-0d55-4d48-b9b8-0f12505ef625 backed by image 2a3554da-9b18-4c8d-a64f-2c347560b016 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '2a3554da-9b18-4c8d-a64f-2c347560b016', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '460d9f5e2fda852b5c24c73f1f663e14', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87269) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b27cc89c-cbbc-41b4-bb7e-fbed1432f402 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "cinder-quobyte-81b8c741-209c-4af5-b9e2-753dab4bd3bc" acquired by "delete_volume" :: waited 0.041s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[45324e94-4826-4700-a04d-d5c06a65c8fa]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b27cc89c-cbbc-41b4-bb7e-fbed1432f402 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-81b8c741-209c-4af5-b9e2-753dab4bd3bc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:16 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-afbaa6d1-ec29-4585-a881-557a6ad612f2" returned: 0 in 0.283s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.168s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1319454897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79b90ff1-6de2-42ef-ac95-64bd1b8c658d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5466302516254de09e6ea7b13e12e04b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:13Z,use_quota=True,user_id='2ae88396d75b4c43b3d3317bb3d21af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Creating volume 79b90ff1-6de2-42ef-ac95-64bd1b8c658d {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:19:16 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-79b90ff1-6de2-42ef-ac95-64bd1b8c658d 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5ecd35-a92d-44e8-84f4-04365eb2bf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afbaa6d1-ec29-4585-a881-557a6ad612f2', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0b6398-6cba-46f7-bcdd-88aef38c35f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:16 devstack sudo[105243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-79b90ff1-6de2-42ef-ac95-64bd1b8c658d 1073741824
Sep 07 18:19:16 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:16 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Volume volume-afbaa6d1-ec29-4585-a881-557a6ad612f2 (afbaa6d1-ec29-4585-a881-557a6ad612f2): created successfully
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c0b6398-6cba-46f7-bcdd-88aef38c35f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Flow 'volume_create_manager' (f7719b16-08f5-4d20-8569-71b0ca217186) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (303723f3-05b3-4a75-b434-14862e9364cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5c62783-0d55-4d48-b9b8-0f12505ef625', 'volume_size': 1, 'image_id': '2a3554da-9b18-4c8d-a64f-2c347560b016', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2a3554da-9b18-4c8d-a64f-2c347560b016', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '460d9f5e2fda852b5c24c73f1f663e14', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd94f780c26c04483843c9a74e44cc557', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'da180f07a96279e646b265a2e6441e695a55ae1ee73d6e287f0f6b8b1b303396fcf5634c67b677a3fc68e3ae6cc04cc37e108e54f6cefa163648d5b1a58cec38', 'id': '2a3554da-9b18-4c8d-a64f-2c347560b016', 'created_at': datetime.datetime(2026, 9, 7, 16, 19, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 16, 19, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2a3554da-9b18-4c8d-a64f-2c347560b016/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d1601706c00>}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:16 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578f2ec1-2678-4735-af37-9653f571e720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:16 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-53cada60-57ae-4b80-b1f0-47be19407595 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Created volume successfully.
Sep 07 18:19:16 devstack sudo[105242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-81b8c741-209c-4af5-b9e2-753dab4bd3bc
Sep 07 18:19:16 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:17 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Volume volume-d5c62783-0d55-4d48-b9b8-0f12505ef625 (d5c62783-0d55-4d48-b9b8-0f12505ef625): created successfully
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578f2ec1-2678-4735-af37-9653f571e720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Flow 'volume_create_manager' (01870308-2144-46f4-ade2-77a1fd51e178) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:17 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-16935928-c1e6-40c7-8ddb-9774e4285cc7 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Created volume successfully.
Sep 07 18:19:17 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b27cc89c-cbbc-41b4-bb7e-fbed1432f402 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-81b8c741-209c-4af5-b9e2-753dab4bd3bc" returned: 0 in 0.475s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b27cc89c-cbbc-41b4-bb7e-fbed1432f402 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-81b8c741-209c-4af5-b9e2-753dab4bd3bc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:17 devstack sudo[105253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-81b8c741-209c-4af5-b9e2-753dab4bd3bc
Sep 07 18:19:17 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-45c1d83c-282e-4f41-9afe-c0ccbb416907 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Acquiring lock "cinder-d5c62783-0d55-4d48-b9b8-0f12505ef625-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:17 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-45c1d83c-282e-4f41-9afe-c0ccbb416907 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Lock "cinder-d5c62783-0d55-4d48-b9b8-0f12505ef625-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-79b90ff1-6de2-42ef-ac95-64bd1b8c658d 1073741824" returned: 0 in 0.557s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-45c1d83c-282e-4f41-9afe-c0ccbb416907 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Acquiring lock "cinder-quobyte-d5c62783-0d55-4d48-b9b8-0f12505ef625" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-79b90ff1-6de2-42ef-ac95-64bd1b8c658d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-45c1d83c-282e-4f41-9afe-c0ccbb416907 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Lock "cinder-quobyte-d5c62783-0d55-4d48-b9b8-0f12505ef625" acquired by "delete_volume" :: waited 0.073s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:17 devstack sudo[105255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-79b90ff1-6de2-42ef-ac95-64bd1b8c658d
Sep 07 18:19:17 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8ed740-ce57-4a0e-9526-f3d70620ab37]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45c1d83c-282e-4f41-9afe-c0ccbb416907 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d5c62783-0d55-4d48-b9b8-0f12505ef625 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:17 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b27cc89c-cbbc-41b4-bb7e-fbed1432f402 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-81b8c741-209c-4af5-b9e2-753dab4bd3bc" returned: 0 in 0.347s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b27cc89c-cbbc-41b4-bb7e-fbed1432f402 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "cinder-quobyte-81b8c741-209c-4af5-b9e2-753dab4bd3bc" released by "delete_volume" :: held 0.876s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:19:17 devstack sudo[105258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d5c62783-0d55-4d48-b9b8-0f12505ef625
Sep 07 18:19:17 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Flow 'volume_create_manager' (21d1716b-9535-49c7-aa23-18db4dd1b880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0ff786-6d57-46f5-8138-c21a85520f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-b27cc89c-cbbc-41b4-bb7e-fbed1432f402 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Created reservations ['cd4df9ad-3d60-4b79-b99e-3ebf61721f55', '75f19f25-1dc5-48e7-a26a-a9fe1b89c6b2', 'ce9fdfb4-47e9-41df-b904-24ae3d0334fc', '14bb840b-6340-4e9f-88f2-a739acd8fd9f'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0ff786-6d57-46f5-8138-c21a85520f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-100201647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c61e9c14-cc90-4171-a1bd-637bf0579c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9e5579de0f4c8e858495790285964a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:18Z,use_quota=True,user_id='deeba2aeb837432cbf3adbffa6511bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbad804e-a387-4ca6-8ce5-1db55e2e7a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbad804e-a387-4ca6-8ce5-1db55e2e7a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11bdef2e-dd92-494d-85e9-36290a1a2753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11bdef2e-dd92-494d-85e9-36290a1a2753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c61e9c14-cc90-4171-a1bd-637bf0579c3f', 'volume_name': 'volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b640cba-bf81-45d4-959a-fdceeb63cae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b640cba-bf81-45d4-959a-fdceeb63cae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c6b4c28-2d45-49ad-938d-b8d9666e163b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:17 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Volume c61e9c14-cc90-4171-a1bd-637bf0579c3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f', 'volume_size': 1}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:17 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-79b90ff1-6de2-42ef-ac95-64bd1b8c658d" returned: 0 in 0.339s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.704s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2085211127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05bc84ba-8bbd-4221-b890-837ecd2d32ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5466302516254de09e6ea7b13e12e04b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:13Z,use_quota=True,user_id='2ae88396d75b4c43b3d3317bb3d21af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Creating volume 05bc84ba-8bbd-4221-b890-837ecd2d32ad {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:19:17 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-05bc84ba-8bbd-4221-b890-837ecd2d32ad 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff2c8e9f-ed3c-4f46-a757-2de430ce94ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79b90ff1-6de2-42ef-ac95-64bd1b8c658d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:17 devstack sudo[105261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-05bc84ba-8bbd-4221-b890-837ecd2d32ad 1073741824
Sep 07 18:19:17 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08cdda84-45fc-496a-89c4-42c87b8af05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:17 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Volume volume-79b90ff1-6de2-42ef-ac95-64bd1b8c658d (79b90ff1-6de2-42ef-ac95-64bd1b8c658d): created successfully
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08cdda84-45fc-496a-89c4-42c87b8af05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Flow 'volume_create_manager' (07d6b641-a322-43e3-8766-50cb5a1eddbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:17 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-014dcb29-0740-4646-a796-b171442a4b7d tempest-CreateVolumesFromSnapshotTest-1287138496 None] Created volume successfully.
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b27cc89c-cbbc-41b4-bb7e-fbed1432f402 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b27cc89c-cbbc-41b4-bb7e-fbed1432f402 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b27cc89c-cbbc-41b4-bb7e-fbed1432f402 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b27cc89c-cbbc-41b4-bb7e-fbed1432f402 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b27cc89c-cbbc-41b4-bb7e-fbed1432f402 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b27cc89c-cbbc-41b4-bb7e-fbed1432f402 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:18 devstack sudo[105265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:19:18 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:18 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45c1d83c-282e-4f41-9afe-c0ccbb416907 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d5c62783-0d55-4d48-b9b8-0f12505ef625" returned: 0 in 0.441s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45c1d83c-282e-4f41-9afe-c0ccbb416907 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d5c62783-0d55-4d48-b9b8-0f12505ef625 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:18 devstack sudo[105268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d5c62783-0d55-4d48-b9b8-0f12505ef625
Sep 07 18:19:18 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:18 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b27cc89c-cbbc-41b4-bb7e-fbed1432f402 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.290s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-b27cc89c-cbbc-41b4-bb7e-fbed1432f402 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:19:18 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b27cc89c-cbbc-41b4-bb7e-fbed1432f402 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Deleted volume successfully.
Sep 07 18:19:18 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-05bc84ba-8bbd-4221-b890-837ecd2d32ad 1073741824" returned: 0 in 0.421s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b27cc89c-cbbc-41b4-bb7e-fbed1432f402 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "cinder-81b8c741-209c-4af5-b9e2-753dab4bd3bc-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-05bc84ba-8bbd-4221-b890-837ecd2d32ad {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:18 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45c1d83c-282e-4f41-9afe-c0ccbb416907 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d5c62783-0d55-4d48-b9b8-0f12505ef625" returned: 0 in 0.294s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-45c1d83c-282e-4f41-9afe-c0ccbb416907 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Lock "cinder-quobyte-d5c62783-0d55-4d48-b9b8-0f12505ef625" released by "delete_volume" :: held 0.792s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:18 devstack sudo[105275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-05bc84ba-8bbd-4221-b890-837ecd2d32ad
Sep 07 18:19:18 devstack sudo[105275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-45c1d83c-282e-4f41-9afe-c0ccbb416907 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Created reservations ['99e4af24-ef10-4b69-86fe-812bf301e1b8', 'b552b55b-101d-453d-821c-fd890d364b26', '81dfea00-763e-4f90-a115-b72bb6f35e0e', '80a9060e-ace0-4800-baac-e5e06acb9e83'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-45c1d83c-282e-4f41-9afe-c0ccbb416907 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-45c1d83c-282e-4f41-9afe-c0ccbb416907 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-45c1d83c-282e-4f41-9afe-c0ccbb416907 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-45c1d83c-282e-4f41-9afe-c0ccbb416907 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-45c1d83c-282e-4f41-9afe-c0ccbb416907 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45c1d83c-282e-4f41-9afe-c0ccbb416907 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:18 devstack sudo[105277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:19:18 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:18 devstack sudo[105275]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-05bc84ba-8bbd-4221-b890-837ecd2d32ad" returned: 0 in 0.260s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.775s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-100201647',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c61e9c14-cc90-4171-a1bd-637bf0579c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9e5579de0f4c8e858495790285964a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:18Z,use_quota=True,user_id='deeba2aeb837432cbf3adbffa6511bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Creating volume c61e9c14-cc90-4171-a1bd-637bf0579c3f {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:19:18 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b4f2fb6-72bd-4c22-8d47-8ee4b77dc851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05bc84ba-8bbd-4221-b890-837ecd2d32ad', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:18 devstack sudo[105280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f 1073741824
Sep 07 18:19:18 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e534b70e-5afc-499b-b91f-bff88ceec35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:18 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Volume volume-05bc84ba-8bbd-4221-b890-837ecd2d32ad (05bc84ba-8bbd-4221-b890-837ecd2d32ad): created successfully
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e534b70e-5afc-499b-b91f-bff88ceec35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Flow 'volume_create_manager' (168101f9-0a5a-47e5-830c-eeedab439e64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:18 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-bdfa8a71-d34f-41ee-8e8b-088a9cbc3347 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Created volume successfully.
Sep 07 18:19:18 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45c1d83c-282e-4f41-9afe-c0ccbb416907 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.352s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-45c1d83c-282e-4f41-9afe-c0ccbb416907 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:19:18 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-45c1d83c-282e-4f41-9afe-c0ccbb416907 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Deleted volume successfully.
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-45c1d83c-282e-4f41-9afe-c0ccbb416907 tempest-VolumeAndVolumeTypeFromImageTest-613774435 None] Lock "cinder-d5c62783-0d55-4d48-b9b8-0f12505ef625-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-45b51c64-87b0-4999-994f-fefaf1a669b9 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "cinder-05bc84ba-8bbd-4221-b890-837ecd2d32ad-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-45b51c64-87b0-4999-994f-fefaf1a669b9 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-05bc84ba-8bbd-4221-b890-837ecd2d32ad-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-45b51c64-87b0-4999-994f-fefaf1a669b9 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "cinder-quobyte-05bc84ba-8bbd-4221-b890-837ecd2d32ad" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-45b51c64-87b0-4999-994f-fefaf1a669b9 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-quobyte-05bc84ba-8bbd-4221-b890-837ecd2d32ad" acquired by "delete_volume" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b4f80eec-8a4c-4395-81e2-6f1435640c88 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "cinder-6cf32c7d-fcc2-4930-bebb-371e238f3f0e-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b4f80eec-8a4c-4395-81e2-6f1435640c88 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "cinder-6cf32c7d-fcc2-4930-bebb-371e238f3f0e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:19 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e9e37b-d021-4a1c-958e-cc25ad283312]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45b51c64-87b0-4999-994f-fefaf1a669b9 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-05bc84ba-8bbd-4221-b890-837ecd2d32ad {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b4f80eec-8a4c-4395-81e2-6f1435640c88 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "cinder-quobyte-6cf32c7d-fcc2-4930-bebb-371e238f3f0e" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b4f80eec-8a4c-4395-81e2-6f1435640c88 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "cinder-quobyte-6cf32c7d-fcc2-4930-bebb-371e238f3f0e" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:19 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb95510b-ed91-4e97-97cd-5e009c740d83]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b4f80eec-8a4c-4395-81e2-6f1435640c88 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6cf32c7d-fcc2-4930-bebb-371e238f3f0e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:19 devstack sudo[105286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-05bc84ba-8bbd-4221-b890-837ecd2d32ad
Sep 07 18:19:19 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:19 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f 1073741824" returned: 0 in 0.668s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:19 devstack sudo[105287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6cf32c7d-fcc2-4930-bebb-371e238f3f0e
Sep 07 18:19:19 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:19 devstack sudo[105289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f
Sep 07 18:19:19 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:19 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45b51c64-87b0-4999-994f-fefaf1a669b9 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-05bc84ba-8bbd-4221-b890-837ecd2d32ad" returned: 0 in 0.452s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45b51c64-87b0-4999-994f-fefaf1a669b9 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-05bc84ba-8bbd-4221-b890-837ecd2d32ad {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:19 devstack sudo[105295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-05bc84ba-8bbd-4221-b890-837ecd2d32ad
Sep 07 18:19:19 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:19 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f" returned: 0 in 0.291s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:19 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:19:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c6b4c28-2d45-49ad-938d-b8d9666e163b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b95a0d-b28b-45d8-8d63-0c03c23f164e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:19 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b4f80eec-8a4c-4395-81e2-6f1435640c88 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6cf32c7d-fcc2-4930-bebb-371e238f3f0e" returned: 0 in 0.439s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b4f80eec-8a4c-4395-81e2-6f1435640c88 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6cf32c7d-fcc2-4930-bebb-371e238f3f0e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:19 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Volume volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f (c61e9c14-cc90-4171-a1bd-637bf0579c3f): created successfully
Sep 07 18:19:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b95a0d-b28b-45d8-8d63-0c03c23f164e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:19 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Flow 'volume_create_manager' (21d1716b-9535-49c7-aa23-18db4dd1b880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:19 devstack sudo[105302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6cf32c7d-fcc2-4930-bebb-371e238f3f0e
Sep 07 18:19:19 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:19 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3d555ed6-580e-4134-85c9-4e98aa236ec8 tempest-VolumeDependencyTests-365708834 None] Created volume successfully.
Sep 07 18:19:19 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:19 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45b51c64-87b0-4999-994f-fefaf1a669b9 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-05bc84ba-8bbd-4221-b890-837ecd2d32ad" returned: 0 in 0.338s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-45b51c64-87b0-4999-994f-fefaf1a669b9 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-quobyte-05bc84ba-8bbd-4221-b890-837ecd2d32ad" released by "delete_volume" :: held 0.864s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:19 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-45b51c64-87b0-4999-994f-fefaf1a669b9 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Created reservations ['99280560-77a7-474d-b07c-872cbd9c4807', '9b17b218-c644-4c25-aa8f-5fbeafba16fb', '72d2c9f3-a211-441a-9c35-730731856651', '17c6f39f-7b63-45ff-8c26-3deece00993d'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:19 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b4f80eec-8a4c-4395-81e2-6f1435640c88 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-6cf32c7d-fcc2-4930-bebb-371e238f3f0e" returned: 0 in 0.347s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b4f80eec-8a4c-4395-81e2-6f1435640c88 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "cinder-quobyte-6cf32c7d-fcc2-4930-bebb-371e238f3f0e" released by "delete_volume" :: held 0.837s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bae084b4-192f-4b17-8357-87546c645a3e tempest-VolumeDependencyTests-365708834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bae084b4-192f-4b17-8357-87546c645a3e tempest-VolumeDependencyTests-365708834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-45b51c64-87b0-4999-994f-fefaf1a669b9 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-45b51c64-87b0-4999-994f-fefaf1a669b9 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-45b51c64-87b0-4999-994f-fefaf1a669b9 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-45b51c64-87b0-4999-994f-fefaf1a669b9 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-45b51c64-87b0-4999-994f-fefaf1a669b9 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45b51c64-87b0-4999-994f-fefaf1a669b9 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-bae084b4-192f-4b17-8357-87546c645a3e tempest-VolumeDependencyTests-365708834 None] Creating offline snapshot 36d7e496-891a-42cb-8b78-4a5744f88d6b of volume c61e9c14-cc90-4171-a1bd-637bf0579c3f {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:19:20 devstack sudo[105306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:19:20 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1432c18d-ecb1-422e-92d2-1ec0f072f75f tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "cinder-79b90ff1-6de2-42ef-ac95-64bd1b8c658d-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-b4f80eec-8a4c-4395-81e2-6f1435640c88 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Created reservations ['852f2f7e-0189-47f9-86a1-325f5e50adec', '58bdc504-13e3-4346-9408-b3544aaf9ba1', '405c5375-18ba-4634-a011-055aa040354d', '60096b61-f8f6-48e5-9297-96a5842ce61e'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5446e02-a586-4593-9943-079f940db924]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1432c18d-ecb1-422e-92d2-1ec0f072f75f tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-79b90ff1-6de2-42ef-ac95-64bd1b8c658d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bae084b4-192f-4b17-8357-87546c645a3e tempest-VolumeDependencyTests-365708834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1432c18d-ecb1-422e-92d2-1ec0f072f75f tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "cinder-quobyte-79b90ff1-6de2-42ef-ac95-64bd1b8c658d" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1432c18d-ecb1-422e-92d2-1ec0f072f75f tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-quobyte-79b90ff1-6de2-42ef-ac95-64bd1b8c658d" acquired by "delete_volume" :: waited 0.043s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:20 devstack sudo[105308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f
Sep 07 18:19:20 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34217e2-1784-4a25-b030-5f5224031a31]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b4f80eec-8a4c-4395-81e2-6f1435640c88 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b4f80eec-8a4c-4395-81e2-6f1435640c88 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b4f80eec-8a4c-4395-81e2-6f1435640c88 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b4f80eec-8a4c-4395-81e2-6f1435640c88 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b4f80eec-8a4c-4395-81e2-6f1435640c88 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b4f80eec-8a4c-4395-81e2-6f1435640c88 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1432c18d-ecb1-422e-92d2-1ec0f072f75f tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-79b90ff1-6de2-42ef-ac95-64bd1b8c658d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:20 devstack sudo[105311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:19:20 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:20 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45b51c64-87b0-4999-994f-fefaf1a669b9 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.372s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-45b51c64-87b0-4999-994f-fefaf1a669b9 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:19:20 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-45b51c64-87b0-4999-994f-fefaf1a669b9 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Deleted volume successfully.
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-45b51c64-87b0-4999-994f-fefaf1a669b9 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-05bc84ba-8bbd-4221-b890-837ecd2d32ad-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:20 devstack sudo[105312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-79b90ff1-6de2-42ef-ac95-64bd1b8c658d
Sep 07 18:19:20 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:20 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bae084b4-192f-4b17-8357-87546c645a3e tempest-VolumeDependencyTests-365708834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f" returned: 0 in 0.503s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bae084b4-192f-4b17-8357-87546c645a3e tempest-VolumeDependencyTests-365708834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.36d7e496-891a-42cb-8b78-4a5744f88d6b 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:20 devstack sudo[105319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.36d7e496-891a-42cb-8b78-4a5744f88d6b 1G
Sep 07 18:19:20 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:20 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b4f80eec-8a4c-4395-81e2-6f1435640c88 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.405s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-b4f80eec-8a4c-4395-81e2-6f1435640c88 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:19:20 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b4f80eec-8a4c-4395-81e2-6f1435640c88 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Deleted volume successfully.
Sep 07 18:19:20 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b4f80eec-8a4c-4395-81e2-6f1435640c88 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "cinder-6cf32c7d-fcc2-4930-bebb-371e238f3f0e-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1432c18d-ecb1-422e-92d2-1ec0f072f75f tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-79b90ff1-6de2-42ef-ac95-64bd1b8c658d" returned: 0 in 0.486s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1432c18d-ecb1-422e-92d2-1ec0f072f75f tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-79b90ff1-6de2-42ef-ac95-64bd1b8c658d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:20 devstack sudo[105326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-79b90ff1-6de2-42ef-ac95-64bd1b8c658d
Sep 07 18:19:20 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:21 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bae084b4-192f-4b17-8357-87546c645a3e tempest-VolumeDependencyTests-365708834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.36d7e496-891a-42cb-8b78-4a5744f88d6b 1G" returned: 0 in 0.478s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bae084b4-192f-4b17-8357-87546c645a3e tempest-VolumeDependencyTests-365708834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.36d7e496-891a-42cb-8b78-4a5744f88d6b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:21 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1432c18d-ecb1-422e-92d2-1ec0f072f75f tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-79b90ff1-6de2-42ef-ac95-64bd1b8c658d" returned: 0 in 0.309s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:21 devstack sudo[105333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.36d7e496-891a-42cb-8b78-4a5744f88d6b
Sep 07 18:19:21 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1432c18d-ecb1-422e-92d2-1ec0f072f75f tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-quobyte-79b90ff1-6de2-42ef-ac95-64bd1b8c658d" released by "delete_volume" :: held 0.901s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:21 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-1432c18d-ecb1-422e-92d2-1ec0f072f75f tempest-CreateVolumesFromSnapshotTest-1287138496 None] Created reservations ['8532af35-9b60-4974-a6e8-3f0227f8a800', 'd19af9b8-c158-4d3c-b719-e2c854b7871d', 'c6ffdfe0-7a1d-4edf-813b-432f551bb87e', '662933c6-8ce9-457e-a6b4-94e2dc02a863'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-caf9e0f1-83a7-4e79-b73e-7e31a1940093 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "cinder-3473c43a-ab9b-44ee-b302-afb409d81aaa-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1432c18d-ecb1-422e-92d2-1ec0f072f75f tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1432c18d-ecb1-422e-92d2-1ec0f072f75f tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1432c18d-ecb1-422e-92d2-1ec0f072f75f tempest-CreateVolumesFromSnapshotTest-1287138496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1432c18d-ecb1-422e-92d2-1ec0f072f75f tempest-CreateVolumesFromSnapshotTest-1287138496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1432c18d-ecb1-422e-92d2-1ec0f072f75f tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1432c18d-ecb1-422e-92d2-1ec0f072f75f tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-caf9e0f1-83a7-4e79-b73e-7e31a1940093 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "cinder-3473c43a-ab9b-44ee-b302-afb409d81aaa-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:21 devstack sudo[105335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:19:21 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-caf9e0f1-83a7-4e79-b73e-7e31a1940093 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "cinder-quobyte-3473c43a-ab9b-44ee-b302-afb409d81aaa" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-caf9e0f1-83a7-4e79-b73e-7e31a1940093 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "cinder-quobyte-3473c43a-ab9b-44ee-b302-afb409d81aaa" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:21 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[45170cc5-f81a-4371-b6b0-8ce492228b2b]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-caf9e0f1-83a7-4e79-b73e-7e31a1940093 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3473c43a-ab9b-44ee-b302-afb409d81aaa {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:21 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bae084b4-192f-4b17-8357-87546c645a3e tempest-VolumeDependencyTests-365708834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.36d7e496-891a-42cb-8b78-4a5744f88d6b" returned: 0 in 0.420s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:21 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-bae084b4-192f-4b17-8357-87546c645a3e tempest-VolumeDependencyTests-365708834 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.36d7e496-891a-42cb-8b78-4a5744f88d6b is being set with open permissions: ugo+rw
Sep 07 18:19:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bae084b4-192f-4b17-8357-87546c645a3e tempest-VolumeDependencyTests-365708834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.36d7e496-891a-42cb-8b78-4a5744f88d6b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:21 devstack sudo[105341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.36d7e496-891a-42cb-8b78-4a5744f88d6b
Sep 07 18:19:21 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:21 devstack sudo[105340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3473c43a-ab9b-44ee-b302-afb409d81aaa
Sep 07 18:19:21 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:21 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1432c18d-ecb1-422e-92d2-1ec0f072f75f tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.320s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:21 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-1432c18d-ecb1-422e-92d2-1ec0f072f75f tempest-CreateVolumesFromSnapshotTest-1287138496 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:19:21 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-1432c18d-ecb1-422e-92d2-1ec0f072f75f tempest-CreateVolumesFromSnapshotTest-1287138496 None] Deleted volume successfully.
Sep 07 18:19:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1432c18d-ecb1-422e-92d2-1ec0f072f75f tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-79b90ff1-6de2-42ef-ac95-64bd1b8c658d-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:21 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bae084b4-192f-4b17-8357-87546c645a3e tempest-VolumeDependencyTests-365708834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.36d7e496-891a-42cb-8b78-4a5744f88d6b" returned: 0 in 0.304s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bae084b4-192f-4b17-8357-87546c645a3e tempest-VolumeDependencyTests-365708834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:22 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-caf9e0f1-83a7-4e79-b73e-7e31a1940093 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3473c43a-ab9b-44ee-b302-afb409d81aaa" returned: 0 in 0.436s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-caf9e0f1-83a7-4e79-b73e-7e31a1940093 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3473c43a-ab9b-44ee-b302-afb409d81aaa {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:22 devstack sudo[105349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.info
Sep 07 18:19:22 devstack sudo[105349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:22 devstack sudo[105350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3473c43a-ab9b-44ee-b302-afb409d81aaa
Sep 07 18:19:22 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:22 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-caf9e0f1-83a7-4e79-b73e-7e31a1940093 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-3473c43a-ab9b-44ee-b302-afb409d81aaa" returned: 0 in 0.292s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:22 devstack sudo[105349]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bae084b4-192f-4b17-8357-87546c645a3e tempest-VolumeDependencyTests-365708834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.info" returned: 0 in 0.327s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:22 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-bae084b4-192f-4b17-8357-87546c645a3e tempest-VolumeDependencyTests-365708834 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.info is being set with open permissions: ugo+rw
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bae084b4-192f-4b17-8357-87546c645a3e tempest-VolumeDependencyTests-365708834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-caf9e0f1-83a7-4e79-b73e-7e31a1940093 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "cinder-quobyte-3473c43a-ab9b-44ee-b302-afb409d81aaa" released by "delete_volume" :: held 0.782s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:22 devstack sudo[105355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.info
Sep 07 18:19:22 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-caf9e0f1-83a7-4e79-b73e-7e31a1940093 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Created reservations ['90d7f503-914b-4208-9794-b6f6f5773ac0', '36583650-c444-4648-86f8-c66909c1c48a', '327c092b-45ef-4e8b-8157-b1b33d0df4c5', '642369f4-92f0-4179-b208-d94b842d13aa'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-caf9e0f1-83a7-4e79-b73e-7e31a1940093 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-caf9e0f1-83a7-4e79-b73e-7e31a1940093 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-caf9e0f1-83a7-4e79-b73e-7e31a1940093 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-caf9e0f1-83a7-4e79-b73e-7e31a1940093 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-caf9e0f1-83a7-4e79-b73e-7e31a1940093 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-caf9e0f1-83a7-4e79-b73e-7e31a1940093 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-30350709-b07a-4cf4-82cf-6f6f75be7f81 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "cinder-afbaa6d1-ec29-4585-a881-557a6ad612f2-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-30350709-b07a-4cf4-82cf-6f6f75be7f81 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-afbaa6d1-ec29-4585-a881-557a6ad612f2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:22 devstack sudo[105357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:19:22 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-30350709-b07a-4cf4-82cf-6f6f75be7f81 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "cinder-quobyte-afbaa6d1-ec29-4585-a881-557a6ad612f2" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-30350709-b07a-4cf4-82cf-6f6f75be7f81 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-quobyte-afbaa6d1-ec29-4585-a881-557a6ad612f2" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1773ef4-752e-4708-a141-60e8513eea44]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-30350709-b07a-4cf4-82cf-6f6f75be7f81 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-afbaa6d1-ec29-4585-a881-557a6ad612f2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:22 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0397cbc7-d073-4754-853c-d94736284389 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "cinder-58f54a19-231d-411b-b28c-4d24fa86e586-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-bae084b4-192f-4b17-8357-87546c645a3e tempest-VolumeDependencyTests-365708834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.info" returned: 0 in 0.384s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-bae084b4-192f-4b17-8357-87546c645a3e tempest-VolumeDependencyTests-365708834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.595s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0397cbc7-d073-4754-853c-d94736284389 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "cinder-58f54a19-231d-411b-b28c-4d24fa86e586-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:22 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-bae084b4-192f-4b17-8357-87546c645a3e tempest-VolumeDependencyTests-365708834 None] Create snapshot completed successfully
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0397cbc7-d073-4754-853c-d94736284389 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "cinder-quobyte-58f54a19-231d-411b-b28c-4d24fa86e586" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0397cbc7-d073-4754-853c-d94736284389 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "cinder-quobyte-58f54a19-231d-411b-b28c-4d24fa86e586" acquired by "delete_volume" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[481f4e79-d13f-40a2-9de4-cf4a552defa6]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0397cbc7-d073-4754-853c-d94736284389 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-58f54a19-231d-411b-b28c-4d24fa86e586 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:22 devstack sudo[105360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-afbaa6d1-ec29-4585-a881-557a6ad612f2
Sep 07 18:19:22 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:22 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-caf9e0f1-83a7-4e79-b73e-7e31a1940093 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.421s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-caf9e0f1-83a7-4e79-b73e-7e31a1940093 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:19:22 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-caf9e0f1-83a7-4e79-b73e-7e31a1940093 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Deleted volume successfully.
Sep 07 18:19:22 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-caf9e0f1-83a7-4e79-b73e-7e31a1940093 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "cinder-3473c43a-ab9b-44ee-b302-afb409d81aaa-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:22 devstack sudo[105363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-58f54a19-231d-411b-b28c-4d24fa86e586
Sep 07 18:19:22 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:23 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-30350709-b07a-4cf4-82cf-6f6f75be7f81 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-afbaa6d1-ec29-4585-a881-557a6ad612f2" returned: 0 in 0.492s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-30350709-b07a-4cf4-82cf-6f6f75be7f81 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-afbaa6d1-ec29-4585-a881-557a6ad612f2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:23 devstack sudo[105368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-afbaa6d1-ec29-4585-a881-557a6ad612f2
Sep 07 18:19:23 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:23 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0397cbc7-d073-4754-853c-d94736284389 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-58f54a19-231d-411b-b28c-4d24fa86e586" returned: 0 in 0.438s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0397cbc7-d073-4754-853c-d94736284389 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-58f54a19-231d-411b-b28c-4d24fa86e586 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:23 devstack sudo[105374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-58f54a19-231d-411b-b28c-4d24fa86e586
Sep 07 18:19:23 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:23 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-30350709-b07a-4cf4-82cf-6f6f75be7f81 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-afbaa6d1-ec29-4585-a881-557a6ad612f2" returned: 0 in 0.315s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-30350709-b07a-4cf4-82cf-6f6f75be7f81 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-quobyte-afbaa6d1-ec29-4585-a881-557a6ad612f2" released by "delete_volume" :: held 0.870s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:23 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-30350709-b07a-4cf4-82cf-6f6f75be7f81 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Created reservations ['f98f6877-c509-42f1-a399-5568fc9083d6', '1555f559-09ef-4676-8d17-54bd3c782ce1', 'ac79fd8b-ac10-4822-8c58-fe3a0eba3c86', '9293babe-cef4-4896-9cd4-b09ed4dd3b4c'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:23 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0397cbc7-d073-4754-853c-d94736284389 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-58f54a19-231d-411b-b28c-4d24fa86e586" returned: 0 in 0.332s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0397cbc7-d073-4754-853c-d94736284389 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "cinder-quobyte-58f54a19-231d-411b-b28c-4d24fa86e586" released by "delete_volume" :: held 0.820s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-30350709-b07a-4cf4-82cf-6f6f75be7f81 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-30350709-b07a-4cf4-82cf-6f6f75be7f81 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-30350709-b07a-4cf4-82cf-6f6f75be7f81 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-30350709-b07a-4cf4-82cf-6f6f75be7f81 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-30350709-b07a-4cf4-82cf-6f6f75be7f81 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-30350709-b07a-4cf4-82cf-6f6f75be7f81 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:23 devstack sudo[105378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:19:23 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:23 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-0397cbc7-d073-4754-853c-d94736284389 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Created reservations ['0a950274-6253-4303-a7d0-f4a0a0c8bd08', '1093c4a3-f004-47d5-aa86-aff4531f7293', '27a9155f-98ba-4cbc-996d-12b8df4b581d', 'adaf6fd3-3eb1-4f35-bca2-7bcaad79c240'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b77f2a1c-fbb1-4ad6-a8a7-e67420901c99 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "cinder-d6386eca-a875-4748-82f1-e0407dd994cc-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b77f2a1c-fbb1-4ad6-a8a7-e67420901c99 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-d6386eca-a875-4748-82f1-e0407dd994cc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b77f2a1c-fbb1-4ad6-a8a7-e67420901c99 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "cinder-quobyte-d6386eca-a875-4748-82f1-e0407dd994cc" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0397cbc7-d073-4754-853c-d94736284389 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0397cbc7-d073-4754-853c-d94736284389 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0397cbc7-d073-4754-853c-d94736284389 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:23 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0397cbc7-d073-4754-853c-d94736284389 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0397cbc7-d073-4754-853c-d94736284389 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0397cbc7-d073-4754-853c-d94736284389 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b77f2a1c-fbb1-4ad6-a8a7-e67420901c99 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-quobyte-d6386eca-a875-4748-82f1-e0407dd994cc" acquired by "delete_volume" :: waited 0.083s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:23 devstack sudo[105380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:19:23 devstack sudo[105380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-da213088-068e-49d6-a7ce-d936398ed44a tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "cinder-d179591d-1728-4a60-bf91-926bc9c377f7-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dd1281-c2e9-4c8a-83ca-eb0fa883c4e2]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b77f2a1c-fbb1-4ad6-a8a7-e67420901c99 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d6386eca-a875-4748-82f1-e0407dd994cc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-da213088-068e-49d6-a7ce-d936398ed44a tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "cinder-d179591d-1728-4a60-bf91-926bc9c377f7-delete_volume" acquired by "delete_volume" :: waited 0.154s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:19:24 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Flow 'volume_create_manager' (c40e3f3d-aa4e-4dc9-8b3d-62f54c3673de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (982e1ac0-bc4a-4c46-9061-f6bba7cc2837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:24 devstack sudo[105385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d6386eca-a875-4748-82f1-e0407dd994cc
Sep 07 18:19:24 devstack sudo[105385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-30350709-b07a-4cf4-82cf-6f6f75be7f81 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.636s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-30350709-b07a-4cf4-82cf-6f6f75be7f81 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:19:24 devstack sudo[105380]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (982e1ac0-bc4a-4c46-9061-f6bba7cc2837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-82871941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28a9432e-475c-4382-b192-945cab23859d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a9e5579de0f4c8e858495790285964a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=36d7e496-891a-42cb-8b78-4a5744f88d6b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:24Z,use_quota=True,user_id='deeba2aeb837432cbf3adbffa6511bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e83ec21c-aa41-447c-969b-802120d70eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e83ec21c-aa41-447c-969b-802120d70eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65501c8a-f7f1-42f8-b636-a7a96d59bf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65501c8a-f7f1-42f8-b636-a7a96d59bf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '28a9432e-475c-4382-b192-945cab23859d', 'volume_name': 'volume-28a9432e-475c-4382-b192-945cab23859d', 'volume_size': 1, 'snapshot_id': '36d7e496-891a-42cb-8b78-4a5744f88d6b'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f804b07-0f25-4925-bbef-a8ccf7953439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f804b07-0f25-4925-bbef-a8ccf7953439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb9285b6-ee02-4b4f-bd8f-82879b0f957f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:24 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Volume 28a9432e-475c-4382-b192-945cab23859d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-28a9432e-475c-4382-b192-945cab23859d', 'volume_size': 1, 'snapshot_id': '36d7e496-891a-42cb-8b78-4a5744f88d6b'}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-da213088-068e-49d6-a7ce-d936398ed44a tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "cinder-quobyte-d179591d-1728-4a60-bf91-926bc9c377f7" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:24 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-30350709-b07a-4cf4-82cf-6f6f75be7f81 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Deleted volume successfully.
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0397cbc7-d073-4754-853c-d94736284389 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.447s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-0397cbc7-d073-4754-853c-d94736284389 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Acquiring lock "cinder-quobyte-36d7e496-891a-42cb-8b78-4a5744f88d6b-28a9432e-475c-4382-b192-945cab23859d" by "_create_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-da213088-068e-49d6-a7ce-d936398ed44a tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "cinder-quobyte-d179591d-1728-4a60-bf91-926bc9c377f7" acquired by "delete_volume" :: waited 0.032s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:24 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0397cbc7-d073-4754-853c-d94736284389 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Deleted volume successfully.
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff4d69e-9a29-4da7-9bce-6d5c815ccd21]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-da213088-068e-49d6-a7ce-d936398ed44a tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d179591d-1728-4a60-bf91-926bc9c377f7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-30350709-b07a-4cf4-82cf-6f6f75be7f81 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-afbaa6d1-ec29-4585-a881-557a6ad612f2-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Lock "cinder-quobyte-36d7e496-891a-42cb-8b78-4a5744f88d6b-28a9432e-475c-4382-b192-945cab23859d" acquired by "_create_volume_from_snapshot" :: waited 0.079s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Creating volume 28a9432e-475c-4382-b192-945cab23859d from snapshot 36d7e496-891a-42cb-8b78-4a5744f88d6b {{(pid=87269) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Acquiring lock "cinder-quobyte-28a9432e-475c-4382-b192-945cab23859d" by "_copy_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-0397cbc7-d073-4754-853c-d94736284389 tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "cinder-58f54a19-231d-411b-b28c-4d24fa86e586-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Lock "cinder-quobyte-28a9432e-475c-4382-b192-945cab23859d" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] snapshot: 36d7e496-891a-42cb-8b78-4a5744f88d6b, volume: 28a9432e-475c-4382-b192-945cab23859d,  {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f30cb4c-7bc1-4890-ad14-d98641310feb]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.36d7e496-891a-42cb-8b78-4a5744f88d6b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:24 devstack sudo[105392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d179591d-1728-4a60-bf91-926bc9c377f7
Sep 07 18:19:24 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:24 devstack sudo[105385]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b77f2a1c-fbb1-4ad6-a8a7-e67420901c99 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d6386eca-a875-4748-82f1-e0407dd994cc" returned: 0 in 0.586s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b77f2a1c-fbb1-4ad6-a8a7-e67420901c99 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d6386eca-a875-4748-82f1-e0407dd994cc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:24 devstack sudo[105399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d6386eca-a875-4748-82f1-e0407dd994cc
Sep 07 18:19:24 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:24 devstack sudo[105397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.36d7e496-891a-42cb-8b78-4a5744f88d6b
Sep 07 18:19:24 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:24 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-da213088-068e-49d6-a7ce-d936398ed44a tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d179591d-1728-4a60-bf91-926bc9c377f7" returned: 0 in 0.433s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-da213088-068e-49d6-a7ce-d936398ed44a tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d179591d-1728-4a60-bf91-926bc9c377f7 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:24 devstack sudo[105406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d179591d-1728-4a60-bf91-926bc9c377f7
Sep 07 18:19:24 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:24 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b77f2a1c-fbb1-4ad6-a8a7-e67420901c99 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d6386eca-a875-4748-82f1-e0407dd994cc" returned: 0 in 0.295s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b77f2a1c-fbb1-4ad6-a8a7-e67420901c99 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-quobyte-d6386eca-a875-4748-82f1-e0407dd994cc" released by "delete_volume" :: held 0.995s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:24 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.36d7e496-891a-42cb-8b78-4a5744f88d6b" returned: 0 in 0.445s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f93a0c7-157b-474c-b85d-cc3322b0e3e0]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-b77f2a1c-fbb1-4ad6-a8a7-e67420901c99 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Created reservations ['089597a4-94ce-4a2f-97d4-6fd1bd956ec6', '16a53625-0510-4a86-8847-f420f867fe7a', 'd332955c-bc1b-4ede-a2c9-f6f0b2b7753f', '9c385d94-8855-4c65-88b7-908a167b3b22'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:25 devstack sudo[105412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f
Sep 07 18:19:25 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:25 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b77f2a1c-fbb1-4ad6-a8a7-e67420901c99 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b77f2a1c-fbb1-4ad6-a8a7-e67420901c99 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b77f2a1c-fbb1-4ad6-a8a7-e67420901c99 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b77f2a1c-fbb1-4ad6-a8a7-e67420901c99 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b77f2a1c-fbb1-4ad6-a8a7-e67420901c99 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b77f2a1c-fbb1-4ad6-a8a7-e67420901c99 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-da213088-068e-49d6-a7ce-d936398ed44a tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d179591d-1728-4a60-bf91-926bc9c377f7" returned: 0 in 0.366s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-da213088-068e-49d6-a7ce-d936398ed44a tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "cinder-quobyte-d179591d-1728-4a60-bf91-926bc9c377f7" released by "delete_volume" :: held 0.851s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:25 devstack sudo[105415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:19:25 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-da213088-068e-49d6-a7ce-d936398ed44a tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Created reservations ['dd8e206c-eced-4c4e-b7b4-6a0802b950ce', '28c2002e-b39f-46ca-b9e9-e02079611396', '3f6c78f0-04f3-4c05-827f-25751f068840', '585a70ee-cc9d-43ff-b651-5db88a616a48'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-da213088-068e-49d6-a7ce-d936398ed44a tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-da213088-068e-49d6-a7ce-d936398ed44a tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-da213088-068e-49d6-a7ce-d936398ed44a tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-da213088-068e-49d6-a7ce-d936398ed44a tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-da213088-068e-49d6-a7ce-d936398ed44a tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-da213088-068e-49d6-a7ce-d936398ed44a tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:25 devstack sudo[105419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:19:25 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:25 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f" returned: 0 in 0.422s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] will copy from snapshot at /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Creating direct copy from snapshot {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG cinder.utils [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Path /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28a9432e-475c-4382-b192-945cab23859d not found in is_blk_device check {{(pid=87269) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28a9432e-475c-4382-b192-945cab23859d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:25 devstack sudo[105422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28a9432e-475c-4382-b192-945cab23859d
Sep 07 18:19:25 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:25 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b77f2a1c-fbb1-4ad6-a8a7-e67420901c99 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.323s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-b77f2a1c-fbb1-4ad6-a8a7-e67420901c99 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:19:25 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b77f2a1c-fbb1-4ad6-a8a7-e67420901c99 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Deleted volume successfully.
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b77f2a1c-fbb1-4ad6-a8a7-e67420901c99 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-d6386eca-a875-4748-82f1-e0407dd994cc-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:25 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-da213088-068e-49d6-a7ce-d936398ed44a tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.272s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-da213088-068e-49d6-a7ce-d936398ed44a tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:19:25 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-da213088-068e-49d6-a7ce-d936398ed44a tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Deleted volume successfully.
Sep 07 18:19:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-da213088-068e-49d6-a7ce-d936398ed44a tempest-CreateVolumesFromSourceVolumeTest-1196483957 None] Lock "cinder-d179591d-1728-4a60-bf91-926bc9c377f7-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d668f469-7177-4486-9bc8-7c89070e9616 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "cinder-28061f8b-b735-4dc8-9cef-ac0aa8f0d56f-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d668f469-7177-4486-9bc8-7c89070e9616 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-28061f8b-b735-4dc8-9cef-ac0aa8f0d56f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d668f469-7177-4486-9bc8-7c89070e9616 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "cinder-quobyte-28061f8b-b735-4dc8-9cef-ac0aa8f0d56f" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d668f469-7177-4486-9bc8-7c89070e9616 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-quobyte-28061f8b-b735-4dc8-9cef-ac0aa8f0d56f" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:26 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2731b0e4-1cec-4b59-bf96-d91ec5ee5f3c]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d668f469-7177-4486-9bc8-7c89070e9616 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28061f8b-b735-4dc8-9cef-ac0aa8f0d56f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:26 devstack sudo[105439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28061f8b-b735-4dc8-9cef-ac0aa8f0d56f
Sep 07 18:19:26 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:27 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d668f469-7177-4486-9bc8-7c89070e9616 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28061f8b-b735-4dc8-9cef-ac0aa8f0d56f" returned: 0 in 1.206s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d668f469-7177-4486-9bc8-7c89070e9616 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28061f8b-b735-4dc8-9cef-ac0aa8f0d56f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:27 devstack sudo[105444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28061f8b-b735-4dc8-9cef-ac0aa8f0d56f
Sep 07 18:19:27 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:28 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d668f469-7177-4486-9bc8-7c89070e9616 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28061f8b-b735-4dc8-9cef-ac0aa8f0d56f" returned: 0 in 0.460s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d668f469-7177-4486-9bc8-7c89070e9616 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-quobyte-28061f8b-b735-4dc8-9cef-ac0aa8f0d56f" released by "delete_volume" :: held 1.786s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:28 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-d668f469-7177-4486-9bc8-7c89070e9616 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Created reservations ['49099ee5-b5fc-4bc4-be62-86b3494be103', 'dc82154f-5b6f-4059-87ff-eb5fdab97544', 'a268361a-1c5e-4afd-9e46-935e8e0a2ac2', '04838902-d074-4fff-84ca-bf0c5615133f'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d668f469-7177-4486-9bc8-7c89070e9616 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d668f469-7177-4486-9bc8-7c89070e9616 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d668f469-7177-4486-9bc8-7c89070e9616 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d668f469-7177-4486-9bc8-7c89070e9616 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d668f469-7177-4486-9bc8-7c89070e9616 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d668f469-7177-4486-9bc8-7c89070e9616 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:28 devstack sudo[105448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:19:28 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4143bd77-89d8-4a8e-8556-30c468e398f3 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "cinder-916f36cc-37df-437a-862e-225dd461d9c0-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4143bd77-89d8-4a8e-8556-30c468e398f3 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-916f36cc-37df-437a-862e-225dd461d9c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4143bd77-89d8-4a8e-8556-30c468e398f3 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "cinder-quobyte-edd38f47-f826-4762-a433-bb0ebe6939a8" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4143bd77-89d8-4a8e-8556-30c468e398f3 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-quobyte-edd38f47-f826-4762-a433-bb0ebe6939a8" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4143bd77-89d8-4a8e-8556-30c468e398f3 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "cinder-quobyte-916f36cc-37df-437a-862e-225dd461d9c0" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4143bd77-89d8-4a8e-8556-30c468e398f3 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-quobyte-916f36cc-37df-437a-862e-225dd461d9c0" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4143bd77-89d8-4a8e-8556-30c468e398f3 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Deleting offline snapshot 916f36cc-37df-437a-862e-225dd461d9c0 of volume edd38f47-f826-4762-a433-bb0ebe6939a8 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:19:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4143bd77-89d8-4a8e-8556-30c468e398f3 tempest-CreateVolumesFromSnapshotTest-1287138496 None] snapshot_file for this snap is: volume-edd38f47-f826-4762-a433-bb0ebe6939a8.916f36cc-37df-437a-862e-225dd461d9c0 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:19:29 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8f6c93-9d52-411b-95d1-7036bc381604]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4143bd77-89d8-4a8e-8556-30c468e398f3 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8.916f36cc-37df-437a-862e-225dd461d9c0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:29 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d668f469-7177-4486-9bc8-7c89070e9616 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.700s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:29 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-d668f469-7177-4486-9bc8-7c89070e9616 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:19:29 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d668f469-7177-4486-9bc8-7c89070e9616 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Deleted volume successfully.
Sep 07 18:19:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d668f469-7177-4486-9bc8-7c89070e9616 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-28061f8b-b735-4dc8-9cef-ac0aa8f0d56f-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:29 devstack sudo[105451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8.916f36cc-37df-437a-862e-225dd461d9c0
Sep 07 18:19:29 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:30 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4143bd77-89d8-4a8e-8556-30c468e398f3 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8.916f36cc-37df-437a-862e-225dd461d9c0" returned: 0 in 0.964s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4143bd77-89d8-4a8e-8556-30c468e398f3 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edd38f47-f826-4762-a433-bb0ebe6939a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:19:30 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d163bf7c-95fe-44c9-9bb7-8b998ad5e9ac]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4143bd77-89d8-4a8e-8556-30c468e398f3 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:30 devstack sudo[105456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8
Sep 07 18:19:30 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:30 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4143bd77-89d8-4a8e-8556-30c468e398f3 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8" returned: 0 in 0.854s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4143bd77-89d8-4a8e-8556-30c468e398f3 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8.916f36cc-37df-437a-862e-225dd461d9c0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:31 devstack sudo[105461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8.916f36cc-37df-437a-862e-225dd461d9c0
Sep 07 18:19:31 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:31 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:31 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28a9432e-475c-4382-b192-945cab23859d" returned: 0 in 6.304s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:31 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Image conversion details: src /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f, size 1024.00 MB, duration 6.31 sec, destination /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28a9432e-475c-4382-b192-945cab23859d {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 07 18:19:31 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Converted 1024.00 MB image at 162.40 MB/s
Sep 07 18:19:31 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28a9432e-475c-4382-b192-945cab23859d is being set with open permissions: ugo+rw
Sep 07 18:19:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28a9432e-475c-4382-b192-945cab23859d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4143bd77-89d8-4a8e-8556-30c468e398f3 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8.916f36cc-37df-437a-862e-225dd461d9c0" returned: 0 in 0.764s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4143bd77-89d8-4a8e-8556-30c468e398f3 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8.916f36cc-37df-437a-862e-225dd461d9c0 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:31 devstack sudo[105468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28a9432e-475c-4382-b192-945cab23859d
Sep 07 18:19:31 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:31 devstack sudo[105469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8.916f36cc-37df-437a-862e-225dd461d9c0
Sep 07 18:19:31 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:32 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28a9432e-475c-4382-b192-945cab23859d" returned: 0 in 0.297s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Lock "cinder-quobyte-28a9432e-475c-4382-b192-945cab23859d" released by "_copy_volume_from_snapshot" :: held 7.588s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:32 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4143bd77-89d8-4a8e-8556-30c468e398f3 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8.916f36cc-37df-437a-862e-225dd461d9c0" returned: 0 in 0.317s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4143bd77-89d8-4a8e-8556-30c468e398f3 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-quobyte-916f36cc-37df-437a-862e-225dd461d9c0" released by "_delete_snapshot" :: held 3.194s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4143bd77-89d8-4a8e-8556-30c468e398f3 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-quobyte-edd38f47-f826-4762-a433-bb0ebe6939a8" released by "delete_snapshot" :: held 3.257s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Lock "cinder-quobyte-36d7e496-891a-42cb-8b78-4a5744f88d6b-28a9432e-475c-4382-b192-945cab23859d" released by "_create_volume_from_snapshot" :: held 7.720s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.801s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb9285b6-ee02-4b4f-bd8f-82879b0f957f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28a9432e-475c-4382-b192-945cab23859d', 'volume_size': 1, 'snapshot_id': '36d7e496-891a-42cb-8b78-4a5744f88d6b'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1edf30da-177a-4937-8ad3-1c6e73d6b490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:32 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Volume volume-28a9432e-475c-4382-b192-945cab23859d (28a9432e-475c-4382-b192-945cab23859d): created successfully
Sep 07 18:19:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1edf30da-177a-4937-8ad3-1c6e73d6b490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:32 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Flow 'volume_create_manager' (c40e3f3d-aa4e-4dc9-8b3d-62f54c3673de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:32 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4208061a-c0b8-4e6c-9679-434e2db0810a tempest-VolumeDependencyTests-365708834 None] Created volume successfully.
Sep 07 18:19:32 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-4143bd77-89d8-4a8e-8556-30c468e398f3 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Created reservations ['d7748f44-4dab-412e-b2de-86ddd611b398', '89f26f60-ab28-47d7-82ea-692bed712e23', 'ca0a3d6c-89a7-468a-8485-66b092fb46ec', '8e3539df-7cab-4592-bb9a-476a2951d348'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:32 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4143bd77-89d8-4a8e-8556-30c468e398f3 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Delete snapshot completed successfully.
Sep 07 18:19:32 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4143bd77-89d8-4a8e-8556-30c468e398f3 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-916f36cc-37df-437a-862e-225dd461d9c0-delete_snapshot" released by "delete_snapshot" :: held 3.510s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d2931510-c8ec-4791-af45-e8cfe007f476 tempest-VolumeDependencyTests-365708834 None] Acquiring lock "cinder-36d7e496-891a-42cb-8b78-4a5744f88d6b-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d2931510-c8ec-4791-af45-e8cfe007f476 tempest-VolumeDependencyTests-365708834 None] Lock "cinder-36d7e496-891a-42cb-8b78-4a5744f88d6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d2931510-c8ec-4791-af45-e8cfe007f476 tempest-VolumeDependencyTests-365708834 None] Acquiring lock "cinder-quobyte-c61e9c14-cc90-4171-a1bd-637bf0579c3f" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d2931510-c8ec-4791-af45-e8cfe007f476 tempest-VolumeDependencyTests-365708834 None] Lock "cinder-quobyte-c61e9c14-cc90-4171-a1bd-637bf0579c3f" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d2931510-c8ec-4791-af45-e8cfe007f476 tempest-VolumeDependencyTests-365708834 None] Acquiring lock "cinder-quobyte-36d7e496-891a-42cb-8b78-4a5744f88d6b" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d2931510-c8ec-4791-af45-e8cfe007f476 tempest-VolumeDependencyTests-365708834 None] Lock "cinder-quobyte-36d7e496-891a-42cb-8b78-4a5744f88d6b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d2931510-c8ec-4791-af45-e8cfe007f476 tempest-VolumeDependencyTests-365708834 None] Deleting offline snapshot 36d7e496-891a-42cb-8b78-4a5744f88d6b of volume c61e9c14-cc90-4171-a1bd-637bf0579c3f {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:19:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d2931510-c8ec-4791-af45-e8cfe007f476 tempest-VolumeDependencyTests-365708834 None] snapshot_file for this snap is: volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.36d7e496-891a-42cb-8b78-4a5744f88d6b {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:19:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e918db9b-1bfc-44ea-bf0d-04eed5996810 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "cinder-edd38f47-f826-4762-a433-bb0ebe6939a8-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:33 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ee2a47-ed2b-4c6c-93e2-8f9f798f13e8]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d2931510-c8ec-4791-af45-e8cfe007f476 tempest-VolumeDependencyTests-365708834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.36d7e496-891a-42cb-8b78-4a5744f88d6b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e918db9b-1bfc-44ea-bf0d-04eed5996810 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-edd38f47-f826-4762-a433-bb0ebe6939a8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e918db9b-1bfc-44ea-bf0d-04eed5996810 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "cinder-quobyte-edd38f47-f826-4762-a433-bb0ebe6939a8" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:33 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e918db9b-1bfc-44ea-bf0d-04eed5996810 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-quobyte-edd38f47-f826-4762-a433-bb0ebe6939a8" acquired by "delete_volume" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:33 devstack sudo[105474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.36d7e496-891a-42cb-8b78-4a5744f88d6b
Sep 07 18:19:33 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:33 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d208a917-3180-4e9e-9e0b-d260f53c8b23]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e918db9b-1bfc-44ea-bf0d-04eed5996810 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:33 devstack sudo[105476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8
Sep 07 18:19:33 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:33 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-730f5c28-e732-4abb-81f7-ed0cbb8d2165 tempest-ProjectAdminTests-753364167 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5530242919922, 'free_capacity_gb': 1773.5530242919922, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87269) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 07 18:19:33 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d2931510-c8ec-4791-af45-e8cfe007f476 tempest-VolumeDependencyTests-365708834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.36d7e496-891a-42cb-8b78-4a5744f88d6b" returned: 0 in 0.437s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-d2931510-c8ec-4791-af45-e8cfe007f476 tempest-VolumeDependencyTests-365708834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:19:33 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[729e5ebf-11f2-4183-85a2-0d5667c6d908]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d2931510-c8ec-4791-af45-e8cfe007f476 tempest-VolumeDependencyTests-365708834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:33 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e918db9b-1bfc-44ea-bf0d-04eed5996810 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8" returned: 0 in 0.454s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e918db9b-1bfc-44ea-bf0d-04eed5996810 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:33 devstack sudo[105481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f
Sep 07 18:19:33 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:34 devstack sudo[105486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8
Sep 07 18:19:34 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:34 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e918db9b-1bfc-44ea-bf0d-04eed5996810 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-edd38f47-f826-4762-a433-bb0ebe6939a8" returned: 0 in 0.329s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e918db9b-1bfc-44ea-bf0d-04eed5996810 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-quobyte-edd38f47-f826-4762-a433-bb0ebe6939a8" released by "delete_volume" :: held 0.867s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Flow 'volume_create_manager' (6d1c9265-7020-44b2-84e0-1f37b2203f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caba66bc-4c5c-409e-b7aa-a1ca3d745340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caba66bc-4c5c-409e-b7aa-a1ca3d745340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1590913414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e32182-2125-4f90-8363-39ae8c279281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e449daccfbab4cd8ba38df886cea84bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:34Z,use_quota=True,user_id='d0204c187bcf4a5ba9582bac88f452df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8a4fa2-420f-4e80-9578-c758ec0e3d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8a4fa2-420f-4e80-9578-c758ec0e3d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92427844-9836-44f6-af4a-6d571f4e8609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92427844-9836-44f6-af4a-6d571f4e8609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0e32182-2125-4f90-8363-39ae8c279281', 'volume_name': 'volume-d0e32182-2125-4f90-8363-39ae8c279281', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f7254bd-6c02-4d77-bd84-d8eead6a8f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f7254bd-6c02-4d77-bd84-d8eead6a8f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e4ac41-280a-44ff-a380-c3f2ad117653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:34 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:34 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Volume d0e32182-2125-4f90-8363-39ae8c279281: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0e32182-2125-4f90-8363-39ae8c279281', 'volume_size': 1}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1590913414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e32182-2125-4f90-8363-39ae8c279281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e449daccfbab4cd8ba38df886cea84bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:34Z,use_quota=True,user_id='d0204c187bcf4a5ba9582bac88f452df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Creating volume d0e32182-2125-4f90-8363-39ae8c279281 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:19:34 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d2931510-c8ec-4791-af45-e8cfe007f476 tempest-VolumeDependencyTests-365708834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f" returned: 0 in 0.702s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d2931510-c8ec-4791-af45-e8cfe007f476 tempest-VolumeDependencyTests-365708834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.36d7e496-891a-42cb-8b78-4a5744f88d6b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:34 devstack sudo[105492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281 1073741824
Sep 07 18:19:34 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-e918db9b-1bfc-44ea-bf0d-04eed5996810 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Created reservations ['27cb24de-63cc-4da1-8d0b-7c97fe993e98', 'd6fd533a-9d7d-47f0-9b97-fd452ac3c3dd', '5c4b8337-ccbe-4ebc-9aa4-dafd9977aa96', 'd94f3e7b-6b85-423a-8f9b-27c93a2addd3'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:34 devstack sudo[105493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.36d7e496-891a-42cb-8b78-4a5744f88d6b
Sep 07 18:19:34 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e918db9b-1bfc-44ea-bf0d-04eed5996810 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e918db9b-1bfc-44ea-bf0d-04eed5996810 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e918db9b-1bfc-44ea-bf0d-04eed5996810 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e918db9b-1bfc-44ea-bf0d-04eed5996810 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e918db9b-1bfc-44ea-bf0d-04eed5996810 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e918db9b-1bfc-44ea-bf0d-04eed5996810 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:34 devstack sudo[105496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:19:34 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:34 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e918db9b-1bfc-44ea-bf0d-04eed5996810 tempest-CreateVolumesFromSnapshotTest-1287138496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.286s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-e918db9b-1bfc-44ea-bf0d-04eed5996810 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:19:34 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e918db9b-1bfc-44ea-bf0d-04eed5996810 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Deleted volume successfully.
Sep 07 18:19:34 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d2931510-c8ec-4791-af45-e8cfe007f476 tempest-VolumeDependencyTests-365708834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.36d7e496-891a-42cb-8b78-4a5744f88d6b" returned: 0 in 0.410s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d2931510-c8ec-4791-af45-e8cfe007f476 tempest-VolumeDependencyTests-365708834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.36d7e496-891a-42cb-8b78-4a5744f88d6b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e918db9b-1bfc-44ea-bf0d-04eed5996810 tempest-CreateVolumesFromSnapshotTest-1287138496 None] Lock "cinder-edd38f47-f826-4762-a433-bb0ebe6939a8-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:34 devstack sudo[105507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.36d7e496-891a-42cb-8b78-4a5744f88d6b
Sep 07 18:19:34 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:35 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281 1073741824" returned: 0 in 0.532s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:35 devstack sudo[105509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281
Sep 07 18:19:35 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:35 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d2931510-c8ec-4791-af45-e8cfe007f476 tempest-VolumeDependencyTests-365708834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f.36d7e496-891a-42cb-8b78-4a5744f88d6b" returned: 0 in 0.276s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d2931510-c8ec-4791-af45-e8cfe007f476 tempest-VolumeDependencyTests-365708834 None] Lock "cinder-quobyte-36d7e496-891a-42cb-8b78-4a5744f88d6b" released by "_delete_snapshot" :: held 1.975s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d2931510-c8ec-4791-af45-e8cfe007f476 tempest-VolumeDependencyTests-365708834 None] Lock "cinder-quobyte-c61e9c14-cc90-4171-a1bd-637bf0579c3f" released by "delete_snapshot" :: held 2.005s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:35 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-d2931510-c8ec-4791-af45-e8cfe007f476 tempest-VolumeDependencyTests-365708834 None] Created reservations ['0d27a8d3-525e-443d-a3a6-dfdd99b99834', '9bc3826d-ecbf-4c1d-bd15-25606155516e', '585e63c5-8940-40d5-8a92-4c3ec2082e24', '6de1cb93-44bb-48dd-8409-9f4d264dd9a7'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:35 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281" returned: 0 in 0.277s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:19:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e4ac41-280a-44ff-a380-c3f2ad117653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0e32182-2125-4f90-8363-39ae8c279281', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65d43a1-e670-4698-85e4-271224cd8792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:35 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Volume volume-d0e32182-2125-4f90-8363-39ae8c279281 (d0e32182-2125-4f90-8363-39ae8c279281): created successfully
Sep 07 18:19:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f65d43a1-e670-4698-85e4-271224cd8792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:35 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Flow 'volume_create_manager' (6d1c9265-7020-44b2-84e0-1f37b2203f67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:35 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-823f1931-2595-4f2e-872d-d0c0508e47af tempest-ProjectMemberTests-442300356 None] Created volume successfully.
Sep 07 18:19:35 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d2931510-c8ec-4791-af45-e8cfe007f476 tempest-VolumeDependencyTests-365708834 None] Delete snapshot completed successfully.
Sep 07 18:19:35 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d2931510-c8ec-4791-af45-e8cfe007f476 tempest-VolumeDependencyTests-365708834 None] Lock "cinder-36d7e496-891a-42cb-8b78-4a5744f88d6b-delete_snapshot" released by "delete_snapshot" :: held 2.212s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cdd57c7c-6646-4daa-93ed-c3c811a91b63 tempest-VolumeDependencyTests-365708834 None] Acquiring lock "cinder-c61e9c14-cc90-4171-a1bd-637bf0579c3f-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cdd57c7c-6646-4daa-93ed-c3c811a91b63 tempest-VolumeDependencyTests-365708834 None] Lock "cinder-c61e9c14-cc90-4171-a1bd-637bf0579c3f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cdd57c7c-6646-4daa-93ed-c3c811a91b63 tempest-VolumeDependencyTests-365708834 None] Acquiring lock "cinder-quobyte-c61e9c14-cc90-4171-a1bd-637bf0579c3f" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cdd57c7c-6646-4daa-93ed-c3c811a91b63 tempest-VolumeDependencyTests-365708834 None] Lock "cinder-quobyte-c61e9c14-cc90-4171-a1bd-637bf0579c3f" acquired by "delete_volume" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:36 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[179f11cf-27fa-4ccd-a537-bb9c79762622]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cdd57c7c-6646-4daa-93ed-c3c811a91b63 tempest-VolumeDependencyTests-365708834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:36 devstack sudo[105515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f
Sep 07 18:19:36 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-83f898da-3cc5-42c5-8377-8354c9c017e7 tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-83f898da-3cc5-42c5-8377-8354c9c017e7 tempest-ProjectMemberTests-442300356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-83f898da-3cc5-42c5-8377-8354c9c017e7 tempest-ProjectMemberTests-442300356 None] Creating offline snapshot b08c5ece-6365-4705-b777-84c6ac809ecd of volume d0e32182-2125-4f90-8363-39ae8c279281 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:19:37 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[57828127-3e2b-406f-9a51-786a2e2c1dae]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-83f898da-3cc5-42c5-8377-8354c9c017e7 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:37 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cdd57c7c-6646-4daa-93ed-c3c811a91b63 tempest-VolumeDependencyTests-365708834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f" returned: 0 in 0.530s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cdd57c7c-6646-4daa-93ed-c3c811a91b63 tempest-VolumeDependencyTests-365708834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:37 devstack sudo[105521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f
Sep 07 18:19:37 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:37 devstack sudo[105520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281
Sep 07 18:19:37 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:37 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cdd57c7c-6646-4daa-93ed-c3c811a91b63 tempest-VolumeDependencyTests-365708834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-c61e9c14-cc90-4171-a1bd-637bf0579c3f" returned: 0 in 0.267s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cdd57c7c-6646-4daa-93ed-c3c811a91b63 tempest-VolumeDependencyTests-365708834 None] Lock "cinder-quobyte-c61e9c14-cc90-4171-a1bd-637bf0579c3f" released by "delete_volume" :: held 0.876s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:37 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-cdd57c7c-6646-4daa-93ed-c3c811a91b63 tempest-VolumeDependencyTests-365708834 None] Created reservations ['70a63dc3-148b-4232-a917-516fe500688d', '50951339-71de-49a7-9ca6-5d7bf15a3119', '11af8188-1fc5-4eb7-9484-a9cafafc1797', 'fe29902e-eb34-46ac-8f1b-decf470fea48'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:37 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-83f898da-3cc5-42c5-8377-8354c9c017e7 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281" returned: 0 in 0.446s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-83f898da-3cc5-42c5-8377-8354c9c017e7 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281.b08c5ece-6365-4705-b777-84c6ac809ecd 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:37 devstack sudo[105528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281.b08c5ece-6365-4705-b777-84c6ac809ecd 1G
Sep 07 18:19:37 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cdd57c7c-6646-4daa-93ed-c3c811a91b63 tempest-VolumeDependencyTests-365708834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cdd57c7c-6646-4daa-93ed-c3c811a91b63 tempest-VolumeDependencyTests-365708834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cdd57c7c-6646-4daa-93ed-c3c811a91b63 tempest-VolumeDependencyTests-365708834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-cdd57c7c-6646-4daa-93ed-c3c811a91b63 tempest-VolumeDependencyTests-365708834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-cdd57c7c-6646-4daa-93ed-c3c811a91b63 tempest-VolumeDependencyTests-365708834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cdd57c7c-6646-4daa-93ed-c3c811a91b63 tempest-VolumeDependencyTests-365708834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:37 devstack sudo[105530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:19:37 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f34435d7-4966-45bc-a3c2-1d333887dddf tempest-VolumeDependencyTests-365708834 None] Acquiring lock "cinder-28a9432e-475c-4382-b192-945cab23859d-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f34435d7-4966-45bc-a3c2-1d333887dddf tempest-VolumeDependencyTests-365708834 None] Lock "cinder-28a9432e-475c-4382-b192-945cab23859d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f34435d7-4966-45bc-a3c2-1d333887dddf tempest-VolumeDependencyTests-365708834 None] Acquiring lock "cinder-quobyte-28a9432e-475c-4382-b192-945cab23859d" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f34435d7-4966-45bc-a3c2-1d333887dddf tempest-VolumeDependencyTests-365708834 None] Lock "cinder-quobyte-28a9432e-475c-4382-b192-945cab23859d" acquired by "delete_volume" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:37 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0d8597-1fcc-4a84-b074-3cf0f45c0caf]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f34435d7-4966-45bc-a3c2-1d333887dddf tempest-VolumeDependencyTests-365708834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28a9432e-475c-4382-b192-945cab23859d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:38 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-cdd57c7c-6646-4daa-93ed-c3c811a91b63 tempest-VolumeDependencyTests-365708834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.402s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:38 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-cdd57c7c-6646-4daa-93ed-c3c811a91b63 tempest-VolumeDependencyTests-365708834 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:19:38 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-cdd57c7c-6646-4daa-93ed-c3c811a91b63 tempest-VolumeDependencyTests-365708834 None] Deleted volume successfully.
Sep 07 18:19:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-cdd57c7c-6646-4daa-93ed-c3c811a91b63 tempest-VolumeDependencyTests-365708834 None] Lock "cinder-c61e9c14-cc90-4171-a1bd-637bf0579c3f-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:38 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-83f898da-3cc5-42c5-8377-8354c9c017e7 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281.b08c5ece-6365-4705-b777-84c6ac809ecd 1G" returned: 0 in 0.591s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-83f898da-3cc5-42c5-8377-8354c9c017e7 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0e32182-2125-4f90-8363-39ae8c279281 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281.b08c5ece-6365-4705-b777-84c6ac809ecd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:38 devstack sudo[105539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28a9432e-475c-4382-b192-945cab23859d
Sep 07 18:19:38 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:38 devstack sudo[105541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0e32182-2125-4f90-8363-39ae8c279281 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281.b08c5ece-6365-4705-b777-84c6ac809ecd
Sep 07 18:19:38 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:38 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f34435d7-4966-45bc-a3c2-1d333887dddf tempest-VolumeDependencyTests-365708834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28a9432e-475c-4382-b192-945cab23859d" returned: 0 in 0.479s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f34435d7-4966-45bc-a3c2-1d333887dddf tempest-VolumeDependencyTests-365708834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28a9432e-475c-4382-b192-945cab23859d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:38 devstack sudo[105551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28a9432e-475c-4382-b192-945cab23859d
Sep 07 18:19:38 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:38 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-83f898da-3cc5-42c5-8377-8354c9c017e7 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0e32182-2125-4f90-8363-39ae8c279281 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281.b08c5ece-6365-4705-b777-84c6ac809ecd" returned: 0 in 0.378s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:38 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-83f898da-3cc5-42c5-8377-8354c9c017e7 tempest-ProjectMemberTests-442300356 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281.b08c5ece-6365-4705-b777-84c6ac809ecd is being set with open permissions: ugo+rw
Sep 07 18:19:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-83f898da-3cc5-42c5-8377-8354c9c017e7 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281.b08c5ece-6365-4705-b777-84c6ac809ecd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:38 devstack sudo[105553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281.b08c5ece-6365-4705-b777-84c6ac809ecd
Sep 07 18:19:38 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:38 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f34435d7-4966-45bc-a3c2-1d333887dddf tempest-VolumeDependencyTests-365708834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-28a9432e-475c-4382-b192-945cab23859d" returned: 0 in 0.294s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:38 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f34435d7-4966-45bc-a3c2-1d333887dddf tempest-VolumeDependencyTests-365708834 None] Lock "cinder-quobyte-28a9432e-475c-4382-b192-945cab23859d" released by "delete_volume" :: held 0.830s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-83f898da-3cc5-42c5-8377-8354c9c017e7 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281.b08c5ece-6365-4705-b777-84c6ac809ecd" returned: 0 in 0.278s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-83f898da-3cc5-42c5-8377-8354c9c017e7 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:38 devstack sudo[105557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281.info
Sep 07 18:19:38 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:38 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-f34435d7-4966-45bc-a3c2-1d333887dddf tempest-VolumeDependencyTests-365708834 None] Created reservations ['eb217125-4ab3-4e78-bea1-720c56ecf01d', 'c2447bb6-f1fd-42ec-a576-db5e863c0e86', 'db7cd614-e1e2-4125-b097-f453e798b503', '98c15889-33e7-4270-862b-c5593a9df984'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f34435d7-4966-45bc-a3c2-1d333887dddf tempest-VolumeDependencyTests-365708834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f34435d7-4966-45bc-a3c2-1d333887dddf tempest-VolumeDependencyTests-365708834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f34435d7-4966-45bc-a3c2-1d333887dddf tempest-VolumeDependencyTests-365708834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f34435d7-4966-45bc-a3c2-1d333887dddf tempest-VolumeDependencyTests-365708834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f34435d7-4966-45bc-a3c2-1d333887dddf tempest-VolumeDependencyTests-365708834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f34435d7-4966-45bc-a3c2-1d333887dddf tempest-VolumeDependencyTests-365708834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:39 devstack sudo[105559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:19:39 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:39 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-83f898da-3cc5-42c5-8377-8354c9c017e7 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281.info" returned: 0 in 0.391s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:39 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-83f898da-3cc5-42c5-8377-8354c9c017e7 tempest-ProjectMemberTests-442300356 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281.info is being set with open permissions: ugo+rw
Sep 07 18:19:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-83f898da-3cc5-42c5-8377-8354c9c017e7 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:39 devstack sudo[105562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281.info
Sep 07 18:19:39 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:39 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f34435d7-4966-45bc-a3c2-1d333887dddf tempest-VolumeDependencyTests-365708834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.306s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:39 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f34435d7-4966-45bc-a3c2-1d333887dddf tempest-VolumeDependencyTests-365708834 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:19:39 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f34435d7-4966-45bc-a3c2-1d333887dddf tempest-VolumeDependencyTests-365708834 None] Deleted volume successfully.
Sep 07 18:19:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-f34435d7-4966-45bc-a3c2-1d333887dddf tempest-VolumeDependencyTests-365708834 None] Lock "cinder-28a9432e-475c-4382-b192-945cab23859d-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:39 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-83f898da-3cc5-42c5-8377-8354c9c017e7 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281.info" returned: 0 in 0.283s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-83f898da-3cc5-42c5-8377-8354c9c017e7 tempest-ProjectMemberTests-442300356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.479s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:39 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-83f898da-3cc5-42c5-8377-8354c9c017e7 tempest-ProjectMemberTests-442300356 None] Create snapshot completed successfully
Sep 07 18:19:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-04c8d2cb-a58a-477a-b61f-79797d15b229 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-b08c5ece-6365-4705-b777-84c6ac809ecd-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-04c8d2cb-a58a-477a-b61f-79797d15b229 tempest-ProjectMemberTests-442300356 None] Lock "cinder-b08c5ece-6365-4705-b777-84c6ac809ecd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-04c8d2cb-a58a-477a-b61f-79797d15b229 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-quobyte-d0e32182-2125-4f90-8363-39ae8c279281" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-04c8d2cb-a58a-477a-b61f-79797d15b229 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-d0e32182-2125-4f90-8363-39ae8c279281" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-04c8d2cb-a58a-477a-b61f-79797d15b229 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-quobyte-b08c5ece-6365-4705-b777-84c6ac809ecd" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:40 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-04c8d2cb-a58a-477a-b61f-79797d15b229 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-b08c5ece-6365-4705-b777-84c6ac809ecd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-04c8d2cb-a58a-477a-b61f-79797d15b229 tempest-ProjectMemberTests-442300356 None] Deleting offline snapshot b08c5ece-6365-4705-b777-84c6ac809ecd of volume d0e32182-2125-4f90-8363-39ae8c279281 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:19:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-04c8d2cb-a58a-477a-b61f-79797d15b229 tempest-ProjectMemberTests-442300356 None] snapshot_file for this snap is: volume-d0e32182-2125-4f90-8363-39ae8c279281.b08c5ece-6365-4705-b777-84c6ac809ecd {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:19:40 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c957ab-622f-424a-b71d-41b8542fc811]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-04c8d2cb-a58a-477a-b61f-79797d15b229 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281.b08c5ece-6365-4705-b777-84c6ac809ecd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:40 devstack sudo[105566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281.b08c5ece-6365-4705-b777-84c6ac809ecd
Sep 07 18:19:40 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:40 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-04c8d2cb-a58a-477a-b61f-79797d15b229 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281.b08c5ece-6365-4705-b777-84c6ac809ecd" returned: 0 in 0.466s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:40 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-04c8d2cb-a58a-477a-b61f-79797d15b229 tempest-ProjectMemberTests-442300356 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0e32182-2125-4f90-8363-39ae8c279281(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:19:40 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6049b5-00b6-42e6-aad5-1eea5e01cb41]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-04c8d2cb-a58a-477a-b61f-79797d15b229 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:41 devstack sudo[105572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281
Sep 07 18:19:41 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:41 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-04c8d2cb-a58a-477a-b61f-79797d15b229 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281" returned: 0 in 0.527s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-04c8d2cb-a58a-477a-b61f-79797d15b229 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281.b08c5ece-6365-4705-b777-84c6ac809ecd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:41 devstack sudo[105577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281.b08c5ece-6365-4705-b777-84c6ac809ecd
Sep 07 18:19:41 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:41 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-04c8d2cb-a58a-477a-b61f-79797d15b229 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281.b08c5ece-6365-4705-b777-84c6ac809ecd" returned: 0 in 0.485s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-04c8d2cb-a58a-477a-b61f-79797d15b229 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281.b08c5ece-6365-4705-b777-84c6ac809ecd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:41 devstack sudo[105582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281.b08c5ece-6365-4705-b777-84c6ac809ecd
Sep 07 18:19:41 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:42 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-04c8d2cb-a58a-477a-b61f-79797d15b229 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281.b08c5ece-6365-4705-b777-84c6ac809ecd" returned: 0 in 0.337s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-04c8d2cb-a58a-477a-b61f-79797d15b229 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-b08c5ece-6365-4705-b777-84c6ac809ecd" released by "_delete_snapshot" :: held 1.975s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-04c8d2cb-a58a-477a-b61f-79797d15b229 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-d0e32182-2125-4f90-8363-39ae8c279281" released by "delete_snapshot" :: held 2.006s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:42 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-04c8d2cb-a58a-477a-b61f-79797d15b229 tempest-ProjectMemberTests-442300356 None] Created reservations ['dc07d00d-c70e-4d51-b540-488583400643', 'b112b190-5b89-4e01-8d95-75501c6ff34a', '32de52c3-672e-427f-b42c-b31a49cb07fa', 'cdff73e4-93c4-4f1f-abcd-a19fe8e8d206'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:42 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-04c8d2cb-a58a-477a-b61f-79797d15b229 tempest-ProjectMemberTests-442300356 None] Delete snapshot completed successfully.
Sep 07 18:19:42 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-04c8d2cb-a58a-477a-b61f-79797d15b229 tempest-ProjectMemberTests-442300356 None] Lock "cinder-b08c5ece-6365-4705-b777-84c6ac809ecd-delete_snapshot" released by "delete_snapshot" :: held 2.214s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:42 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:19:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Flow 'volume_create_manager' (e9d67934-c8b2-4772-8374-fa0436e31d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a056e6-0685-4160-978e-03a4dbc19eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a056e6-0685-4160-978e-03a4dbc19eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=020a670b-b792-4bb8-8cc9-be87c0b03a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4977f53057bc4bf2a8c775d9e3b6551a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:43Z,use_quota=True,user_id='9e0225db96c64b9f98e247f830bea638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e4fb767-950b-4f5b-876a-6c521485fe57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e4fb767-950b-4f5b-876a-6c521485fe57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61445876-852e-4c69-a256-9ba4bd66ca00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:42 devstack cinder-volume[87269]: DEBUG cinder.image.glance [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Creating Keystone auth plugin from conf {{(pid=87269) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 07 18:19:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61445876-852e-4c69-a256-9ba4bd66ca00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '020a670b-b792-4bb8-8cc9-be87c0b03a1f', 'volume_name': 'volume-020a670b-b792-4bb8-8cc9-be87c0b03a1f', 'volume_size': 1, 'image_id': '4f1528ca-4fcf-462d-acba-abb6b4fa62ed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f1528ca-4fcf-462d-acba-abb6b4fa62ed', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5393120e1abf4f4fff1e8b240c8084d6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4977f53057bc4bf2a8c775d9e3b6551a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fe5ae6753f00191f5ba147ebeaa30f2ec79a6ae363c54c9b43223449ed1dd66b3e4a6ecd2b24591020d843ac5dd417afca24d9f38fcbd7236a05732f253131f2', 'id': '4f1528ca-4fcf-462d-acba-abb6b4fa62ed', 'created_at': datetime.datetime(2026, 9, 7, 16, 19, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 16, 19, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f1528ca-4fcf-462d-acba-abb6b4fa62ed/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d160165dcd0>}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2196eb-5a5f-4e47-bf56-e0be93b4a0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da2196eb-5a5f-4e47-bf56-e0be93b4a0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:43 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a3cb29a-3815-45f3-8dc2-f95ec8fa3953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:43 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Volume 020a670b-b792-4bb8-8cc9-be87c0b03a1f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-020a670b-b792-4bb8-8cc9-be87c0b03a1f', 'volume_size': 1, 'image_id': '4f1528ca-4fcf-462d-acba-abb6b4fa62ed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f1528ca-4fcf-462d-acba-abb6b4fa62ed', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5393120e1abf4f4fff1e8b240c8084d6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4977f53057bc4bf2a8c775d9e3b6551a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fe5ae6753f00191f5ba147ebeaa30f2ec79a6ae363c54c9b43223449ed1dd66b3e4a6ecd2b24591020d843ac5dd417afca24d9f38fcbd7236a05732f253131f2', 'id': '4f1528ca-4fcf-462d-acba-abb6b4fa62ed', 'created_at': datetime.datetime(2026, 9, 7, 16, 19, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 16, 19, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f1528ca-4fcf-462d-acba-abb6b4fa62ed/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d160165dcd0>}
Sep 07 18:19:43 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Trying to clone 020a670b-b792-4bb8-8cc9-be87c0b03a1f from image 4f1528ca-4fcf-462d-acba-abb6b4fa62ed at location (None, [{'url': 'file:///opt/stack/data/glance/images/4f1528ca-4fcf-462d-acba-abb6b4fa62ed', 'metadata': {}}]). {{(pid=87269) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 07 18:19:43 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4f1528ca-4fcf-462d-acba-abb6b4fa62ed_bfo9sgrtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 07 18:19:43 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Image download 0.00 MB at 0.00 MB/s
Sep 07 18:19:43 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d278d28-ecf4-4dcb-a5c0-e0ca58e0b3e8]: (4, 'raw') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1528ca-4fcf-462d-acba-abb6b4fa62ed_bfo9sgrtdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7006a2d8-f67a-41c7-ac6e-f16f4759a044 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-d0e32182-2125-4f90-8363-39ae8c279281-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7006a2d8-f67a-41c7-ac6e-f16f4759a044 tempest-ProjectMemberTests-442300356 None] Lock "cinder-d0e32182-2125-4f90-8363-39ae8c279281-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7006a2d8-f67a-41c7-ac6e-f16f4759a044 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-quobyte-d0e32182-2125-4f90-8363-39ae8c279281" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:43 devstack sudo[105585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1528ca-4fcf-462d-acba-abb6b4fa62ed_bfo9sgrtdevstack@QuobyteHD
Sep 07 18:19:43 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7006a2d8-f67a-41c7-ac6e-f16f4759a044 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-d0e32182-2125-4f90-8363-39ae8c279281" acquired by "delete_volume" :: waited 0.037s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:43 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f720008d-5262-44e8-8dca-1d4ad6d94247]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7006a2d8-f67a-41c7-ac6e-f16f4759a044 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:43 devstack sudo[105587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281
Sep 07 18:19:43 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:43 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1528ca-4fcf-462d-acba-abb6b4fa62ed_bfo9sgrtdevstack@QuobyteHD" returned: 0 in 0.440s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1528ca-4fcf-462d-acba-abb6b4fa62ed_bfo9sgrtdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:44 devstack sudo[105591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1528ca-4fcf-462d-acba-abb6b4fa62ed_bfo9sgrtdevstack@QuobyteHD
Sep 07 18:19:44 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:44 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7006a2d8-f67a-41c7-ac6e-f16f4759a044 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281" returned: 0 in 0.541s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7006a2d8-f67a-41c7-ac6e-f16f4759a044 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:44 devstack sudo[105596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281
Sep 07 18:19:44 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:44 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1528ca-4fcf-462d-acba-abb6b4fa62ed_bfo9sgrtdevstack@QuobyteHD" returned: 1 in 0.483s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1528ca-4fcf-462d-acba-abb6b4fa62ed_bfo9sgrtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 07 18:19:44 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Temporary image 4f1528ca-4fcf-462d-acba-abb6b4fa62ed is fetched for user 9e0225db96c64b9f98e247f830bea638. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 07 18:19:44 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5710eaa5-f80e-4107-b1e6-c85c0903cee1]: (4, 'raw') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1528ca-4fcf-462d-acba-abb6b4fa62ed_bfo9sgrtdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:44 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7006a2d8-f67a-41c7-ac6e-f16f4759a044 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-d0e32182-2125-4f90-8363-39ae8c279281" returned: 0 in 0.302s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7006a2d8-f67a-41c7-ac6e-f16f4759a044 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-d0e32182-2125-4f90-8363-39ae8c279281" released by "delete_volume" :: held 0.943s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:44 devstack sudo[105601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1528ca-4fcf-462d-acba-abb6b4fa62ed_bfo9sgrtdevstack@QuobyteHD
Sep 07 18:19:44 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:44 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-7006a2d8-f67a-41c7-ac6e-f16f4759a044 tempest-ProjectMemberTests-442300356 None] Created reservations ['95bf6a8d-2499-443e-90d1-7dfd410f24bd', '5a3510f0-4827-4661-948f-e42a3a61d982', '380d1169-482a-4a21-9568-8dad12c0889b', '938fe072-d4fb-4089-bd2e-bdadc2e2c839'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7006a2d8-f67a-41c7-ac6e-f16f4759a044 tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7006a2d8-f67a-41c7-ac6e-f16f4759a044 tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7006a2d8-f67a-41c7-ac6e-f16f4759a044 tempest-ProjectMemberTests-442300356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-7006a2d8-f67a-41c7-ac6e-f16f4759a044 tempest-ProjectMemberTests-442300356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-7006a2d8-f67a-41c7-ac6e-f16f4759a044 tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7006a2d8-f67a-41c7-ac6e-f16f4759a044 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:44 devstack sudo[105604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:19:44 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:44 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1528ca-4fcf-462d-acba-abb6b4fa62ed_bfo9sgrtdevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1528ca-4fcf-462d-acba-abb6b4fa62ed_bfo9sgrtdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:45 devstack sudo[105608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1528ca-4fcf-462d-acba-abb6b4fa62ed_bfo9sgrtdevstack@QuobyteHD
Sep 07 18:19:45 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:45 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7006a2d8-f67a-41c7-ac6e-f16f4759a044 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.350s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:45 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-7006a2d8-f67a-41c7-ac6e-f16f4759a044 tempest-ProjectMemberTests-442300356 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:19:45 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-7006a2d8-f67a-41c7-ac6e-f16f4759a044 tempest-ProjectMemberTests-442300356 None] Deleted volume successfully.
Sep 07 18:19:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7006a2d8-f67a-41c7-ac6e-f16f4759a044 tempest-ProjectMemberTests-442300356 None] Lock "cinder-d0e32182-2125-4f90-8363-39ae8c279281-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:45 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1528ca-4fcf-462d-acba-abb6b4fa62ed_bfo9sgrtdevstack@QuobyteHD" returned: 1 in 0.371s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1528ca-4fcf-462d-acba-abb6b4fa62ed_bfo9sgrtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 07 18:19:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=020a670b-b792-4bb8-8cc9-be87c0b03a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4977f53057bc4bf2a8c775d9e3b6551a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:43Z,use_quota=True,user_id='9e0225db96c64b9f98e247f830bea638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:19:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Creating volume 020a670b-b792-4bb8-8cc9-be87c0b03a1f {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:19:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:19:45 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:19:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-020a670b-b792-4bb8-8cc9-be87c0b03a1f 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:45 devstack sudo[105614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-020a670b-b792-4bb8-8cc9-be87c0b03a1f 1073741824
Sep 07 18:19:45 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:45 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-020a670b-b792-4bb8-8cc9-be87c0b03a1f 1073741824" returned: 0 in 0.546s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-020a670b-b792-4bb8-8cc9-be87c0b03a1f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:45 devstack sudo[105620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-020a670b-b792-4bb8-8cc9-be87c0b03a1f
Sep 07 18:19:45 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:46 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-020a670b-b792-4bb8-8cc9-be87c0b03a1f" returned: 0 in 0.366s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Attempting download of 4f1528ca-4fcf-462d-acba-abb6b4fa62ed ((None, [{'url': 'file:///opt/stack/data/glance/images/4f1528ca-4fcf-462d-acba-abb6b4fa62ed', 'metadata': {}}])) to volume 020a670b-b792-4bb8-8cc9-be87c0b03a1f. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[75073790-3d50-4a80-954c-9e4603be50f4]: (4, 'raw') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f1528ca-4fcf-462d-acba-abb6b4fa62ed__2kp_e0y {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Flow 'volume_create_manager' (42bf1db0-d8f6-4d33-a9f7-2f3b3c1752e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab2aa1d-094e-4d77-8357-4fd35ed0392a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ab2aa1d-094e-4d77-8357-4fd35ed0392a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-698282476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34258ee5-5169-4a3a-8d7f-cc63ebffdcfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e449daccfbab4cd8ba38df886cea84bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:46Z,use_quota=True,user_id='d0204c187bcf4a5ba9582bac88f452df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed779c6d-5d81-48cc-98f6-a2c27ee964ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed779c6d-5d81-48cc-98f6-a2c27ee964ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6f6a17-5b79-4042-8079-59b135322f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6f6a17-5b79-4042-8079-59b135322f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34258ee5-5169-4a3a-8d7f-cc63ebffdcfc', 'volume_name': 'volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e224da2b-9393-4b49-9f30-d52979d1ac41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e224da2b-9393-4b49-9f30-d52979d1ac41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb5add2-f443-4b00-9a15-6a9114174d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:46 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Volume 34258ee5-5169-4a3a-8d7f-cc63ebffdcfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc', 'volume_size': 1}
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-698282476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34258ee5-5169-4a3a-8d7f-cc63ebffdcfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e449daccfbab4cd8ba38df886cea84bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:46Z,use_quota=True,user_id='d0204c187bcf4a5ba9582bac88f452df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Creating volume 34258ee5-5169-4a3a-8d7f-cc63ebffdcfc {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:19:46 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:46 devstack sudo[105623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f1528ca-4fcf-462d-acba-abb6b4fa62ed__2kp_e0y
Sep 07 18:19:46 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:46 devstack sudo[105625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc 1073741824
Sep 07 18:19:46 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:46 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4f1528ca-4fcf-462d-acba-abb6b4fa62ed__2kp_e0y" returned: 0 in 0.427s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f1528ca-4fcf-462d-acba-abb6b4fa62ed__2kp_e0y {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:47 devstack sudo[105633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f1528ca-4fcf-462d-acba-abb6b4fa62ed__2kp_e0y
Sep 07 18:19:47 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:47 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc 1073741824" returned: 0 in 0.593s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:47 devstack sudo[105636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc
Sep 07 18:19:47 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:47 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f1528ca-4fcf-462d-acba-abb6b4fa62ed__2kp_e0y" returned: 1 in 0.530s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4f1528ca-4fcf-462d-acba-abb6b4fa62ed__2kp_e0y' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 07 18:19:47 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9d0784-1252-4049-9638-136cb5a9fc2a]: (4, 'raw') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1528ca-4fcf-462d-acba-abb6b4fa62ed_bfo9sgrtdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:47 devstack sudo[105640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1528ca-4fcf-462d-acba-abb6b4fa62ed_bfo9sgrtdevstack@QuobyteHD
Sep 07 18:19:47 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:47 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc" returned: 0 in 0.322s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:47 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:19:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb5add2-f443-4b00-9a15-6a9114174d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c151e427-420d-4b72-9590-1c79088ce553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:47 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Volume volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc (34258ee5-5169-4a3a-8d7f-cc63ebffdcfc): created successfully
Sep 07 18:19:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c151e427-420d-4b72-9590-1c79088ce553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:47 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Flow 'volume_create_manager' (42bf1db0-d8f6-4d33-a9f7-2f3b3c1752e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:47 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0da290f1-2419-4c4d-862d-54f0b67f4729 tempest-ProjectMemberTests-442300356 None] Created volume successfully.
Sep 07 18:19:47 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1528ca-4fcf-462d-acba-abb6b4fa62ed_bfo9sgrtdevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1528ca-4fcf-462d-acba-abb6b4fa62ed_bfo9sgrtdevstack@QuobyteHD {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:47 devstack sudo[105645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1528ca-4fcf-462d-acba-abb6b4fa62ed_bfo9sgrtdevstack@QuobyteHD
Sep 07 18:19:47 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:48 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1528ca-4fcf-462d-acba-abb6b4fa62ed_bfo9sgrtdevstack@QuobyteHD" returned: 1 in 0.376s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4f1528ca-4fcf-462d-acba-abb6b4fa62ed_bfo9sgrtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 07 18:19:48 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] 4f1528ca-4fcf-462d-acba-abb6b4fa62ed was raw, converting to qcow2 {{(pid=87269) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 07 18:19:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4f1528ca-4fcf-462d-acba-abb6b4fa62ed_bfo9sgrtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-020a670b-b792-4bb8-8cc9-be87c0b03a1f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:48 devstack sudo[105650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4f1528ca-4fcf-462d-acba-abb6b4fa62ed_bfo9sgrtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-020a670b-b792-4bb8-8cc9-be87c0b03a1f
Sep 07 18:19:48 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-58ea6539-1be1-4a7a-a13c-15959b829189 tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-58ea6539-1be1-4a7a-a13c-15959b829189 tempest-ProjectMemberTests-442300356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-58ea6539-1be1-4a7a-a13c-15959b829189 tempest-ProjectMemberTests-442300356 None] Creating offline snapshot aa933e3d-f4ef-41ee-8d92-73c09eca8844 of volume 34258ee5-5169-4a3a-8d7f-cc63ebffdcfc {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:19:48 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[288cabde-8703-413f-9371-4bfbb5811124]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58ea6539-1be1-4a7a-a13c-15959b829189 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:48 devstack sudo[105656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc
Sep 07 18:19:48 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:48 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4f1528ca-4fcf-462d-acba-abb6b4fa62ed_bfo9sgrtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-020a670b-b792-4bb8-8cc9-be87c0b03a1f" returned: 0 in 0.801s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:48 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4f1528ca-4fcf-462d-acba-abb6b4fa62ed_bfo9sgrtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-020a670b-b792-4bb8-8cc9-be87c0b03a1f {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 07 18:19:48 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Converted 0.00 MB image at 0.00 MB/s
Sep 07 18:19:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-020a670b-b792-4bb8-8cc9-be87c0b03a1f 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:49 devstack sudo[105658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-020a670b-b792-4bb8-8cc9-be87c0b03a1f 1G
Sep 07 18:19:49 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:49 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58ea6539-1be1-4a7a-a13c-15959b829189 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc" returned: 0 in 0.580s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58ea6539-1be1-4a7a-a13c-15959b829189 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc.aa933e3d-f4ef-41ee-8d92-73c09eca8844 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:49 devstack sudo[105665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc.aa933e3d-f4ef-41ee-8d92-73c09eca8844 1G
Sep 07 18:19:49 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:49 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-020a670b-b792-4bb8-8cc9-be87c0b03a1f 1G" returned: 0 in 0.555s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:49 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Downloaded image 4f1528ca-4fcf-462d-acba-abb6b4fa62ed ((None, [{'url': 'file:///opt/stack/data/glance/images/4f1528ca-4fcf-462d-acba-abb6b4fa62ed', 'metadata': {}}])) to volume 020a670b-b792-4bb8-8cc9-be87c0b03a1f successfully. {{(pid=87269) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 07 18:19:49 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Temporary image 4f1528ca-4fcf-462d-acba-abb6b4fa62ed for user 9e0225db96c64b9f98e247f830bea638 is deleted. {{(pid=87269) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 07 18:19:49 devstack cinder-volume[87269]: DEBUG cinder.volume.volume_utils [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Marking volume 020a670b-b792-4bb8-8cc9-be87c0b03a1f as bootable. {{(pid=87269) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 07 18:19:49 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Copying metadata from image 4f1528ca-4fcf-462d-acba-abb6b4fa62ed to 020a670b-b792-4bb8-8cc9-be87c0b03a1f. {{(pid=87269) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 07 18:19:49 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Creating volume glance metadata for volume 020a670b-b792-4bb8-8cc9-be87c0b03a1f backed by image 4f1528ca-4fcf-462d-acba-abb6b4fa62ed with: {'image_id': '4f1528ca-4fcf-462d-acba-abb6b4fa62ed', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5393120e1abf4f4fff1e8b240c8084d6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87269) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 07 18:19:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a3cb29a-3815-45f3-8dc2-f95ec8fa3953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-020a670b-b792-4bb8-8cc9-be87c0b03a1f', 'volume_size': 1, 'image_id': '4f1528ca-4fcf-462d-acba-abb6b4fa62ed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4f1528ca-4fcf-462d-acba-abb6b4fa62ed', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5393120e1abf4f4fff1e8b240c8084d6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4977f53057bc4bf2a8c775d9e3b6551a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fe5ae6753f00191f5ba147ebeaa30f2ec79a6ae363c54c9b43223449ed1dd66b3e4a6ecd2b24591020d843ac5dd417afca24d9f38fcbd7236a05732f253131f2', 'id': '4f1528ca-4fcf-462d-acba-abb6b4fa62ed', 'created_at': datetime.datetime(2026, 9, 7, 16, 19, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 16, 19, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4f1528ca-4fcf-462d-acba-abb6b4fa62ed/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7d160165dcd0>}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f39cfdc-9c3a-4765-9726-b1f2cb2e7c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:49 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Volume volume-020a670b-b792-4bb8-8cc9-be87c0b03a1f (020a670b-b792-4bb8-8cc9-be87c0b03a1f): created successfully
Sep 07 18:19:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f39cfdc-9c3a-4765-9726-b1f2cb2e7c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Flow 'volume_create_manager' (e9d67934-c8b2-4772-8374-fa0436e31d98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:49 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e5acc0a3-f21b-4251-a8c0-369889283636 tempest-VolumeImageDependencyTests-1965452004 None] Created volume successfully.
Sep 07 18:19:49 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58ea6539-1be1-4a7a-a13c-15959b829189 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc.aa933e3d-f4ef-41ee-8d92-73c09eca8844 1G" returned: 0 in 0.648s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58ea6539-1be1-4a7a-a13c-15959b829189 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc.aa933e3d-f4ef-41ee-8d92-73c09eca8844 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:50 devstack sudo[105672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc.aa933e3d-f4ef-41ee-8d92-73c09eca8844
Sep 07 18:19:50 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:50 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58ea6539-1be1-4a7a-a13c-15959b829189 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc.aa933e3d-f4ef-41ee-8d92-73c09eca8844" returned: 0 in 0.351s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:50 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-58ea6539-1be1-4a7a-a13c-15959b829189 tempest-ProjectMemberTests-442300356 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc.aa933e3d-f4ef-41ee-8d92-73c09eca8844 is being set with open permissions: ugo+rw
Sep 07 18:19:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58ea6539-1be1-4a7a-a13c-15959b829189 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc.aa933e3d-f4ef-41ee-8d92-73c09eca8844 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:50 devstack sudo[105677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc.aa933e3d-f4ef-41ee-8d92-73c09eca8844
Sep 07 18:19:50 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-db454619-ca6a-4b53-8cac-7a246a8fdc38 tempest-VolumeImageDependencyTests-1965452004 None] Acquiring lock "cinder-020a670b-b792-4bb8-8cc9-be87c0b03a1f-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-db454619-ca6a-4b53-8cac-7a246a8fdc38 tempest-VolumeImageDependencyTests-1965452004 None] Lock "cinder-020a670b-b792-4bb8-8cc9-be87c0b03a1f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-db454619-ca6a-4b53-8cac-7a246a8fdc38 tempest-VolumeImageDependencyTests-1965452004 None] Acquiring lock "cinder-quobyte-020a670b-b792-4bb8-8cc9-be87c0b03a1f" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:50 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:19:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Flow 'volume_create_manager' (d9f953af-b10f-4dda-9a12-22c81e19a086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31325ad-7039-4462-9c6d-dfeaca0b2ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-db454619-ca6a-4b53-8cac-7a246a8fdc38 tempest-VolumeImageDependencyTests-1965452004 None] Lock "cinder-quobyte-020a670b-b792-4bb8-8cc9-be87c0b03a1f" acquired by "delete_volume" :: waited 0.056s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f31325ad-7039-4462-9c6d-dfeaca0b2ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1034772726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b4200f-f4cd-4461-a47b-7d2de818b315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b8e30667d9491680120f3ae1aaac5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:51Z,use_quota=True,user_id='4c1e7a9ef62d4198bf344d0b36569a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:50 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5880f904-da71-4f10-8372-7b33a3bca311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5880f904-da71-4f10-8372-7b33a3bca311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0ffc31-5cc2-426b-960f-ef907a78387e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0ffc31-5cc2-426b-960f-ef907a78387e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18b4200f-f4cd-4461-a47b-7d2de818b315', 'volume_name': 'volume-18b4200f-f4cd-4461-a47b-7d2de818b315', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed90005a-adcd-48e6-8f84-193324b3ebe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed90005a-adcd-48e6-8f84-193324b3ebe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f203fb57-6fd5-4d58-bc4e-545c0031046e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:50 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Volume 18b4200f-f4cd-4461-a47b-7d2de818b315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18b4200f-f4cd-4461-a47b-7d2de818b315', 'volume_size': 1}
Sep 07 18:19:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:50 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b628ba-3e57-4f7e-bd00-57dbb2352f27]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-db454619-ca6a-4b53-8cac-7a246a8fdc38 tempest-VolumeImageDependencyTests-1965452004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-020a670b-b792-4bb8-8cc9-be87c0b03a1f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58ea6539-1be1-4a7a-a13c-15959b829189 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc.aa933e3d-f4ef-41ee-8d92-73c09eca8844" returned: 0 in 0.421s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:50 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=199,cinder:UPDATE=265,cinder:INSERT=68,cinder:DELETE=27 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:19:50 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=261,cinder:SELECT=191,cinder:DELETE=20,cinder:INSERT=74 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:19:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58ea6539-1be1-4a7a-a13c-15959b829189 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:50 devstack sudo[105681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc.info
Sep 07 18:19:50 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:50 devstack sudo[105680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-020a670b-b792-4bb8-8cc9-be87c0b03a1f
Sep 07 18:19:50 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:51 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58ea6539-1be1-4a7a-a13c-15959b829189 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc.info" returned: 0 in 0.334s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:51 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-58ea6539-1be1-4a7a-a13c-15959b829189 tempest-ProjectMemberTests-442300356 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc.info is being set with open permissions: ugo+rw
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58ea6539-1be1-4a7a-a13c-15959b829189 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:51 devstack sudo[105685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc.info
Sep 07 18:19:51 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:51 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-db454619-ca6a-4b53-8cac-7a246a8fdc38 tempest-VolumeImageDependencyTests-1965452004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-020a670b-b792-4bb8-8cc9-be87c0b03a1f" returned: 0 in 0.486s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-db454619-ca6a-4b53-8cac-7a246a8fdc38 tempest-VolumeImageDependencyTests-1965452004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-020a670b-b792-4bb8-8cc9-be87c0b03a1f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:51 devstack sudo[105690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-020a670b-b792-4bb8-8cc9-be87c0b03a1f
Sep 07 18:19:51 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:51 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58ea6539-1be1-4a7a-a13c-15959b829189 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc.info" returned: 0 in 0.282s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-58ea6539-1be1-4a7a-a13c-15959b829189 tempest-ProjectMemberTests-442300356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.729s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.696s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1034772726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b4200f-f4cd-4461-a47b-7d2de818b315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b8e30667d9491680120f3ae1aaac5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:51Z,use_quota=True,user_id='4c1e7a9ef62d4198bf344d0b36569a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Creating volume 18b4200f-f4cd-4461-a47b-7d2de818b315 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:19:51 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-18b4200f-f4cd-4461-a47b-7d2de818b315 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:51 devstack sudo[105693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-18b4200f-f4cd-4461-a47b-7d2de818b315 1073741824
Sep 07 18:19:51 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:51 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-58ea6539-1be1-4a7a-a13c-15959b829189 tempest-ProjectMemberTests-442300356 None] Create snapshot completed successfully
Sep 07 18:19:51 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-db454619-ca6a-4b53-8cac-7a246a8fdc38 tempest-VolumeImageDependencyTests-1965452004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-020a670b-b792-4bb8-8cc9-be87c0b03a1f" returned: 0 in 0.286s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-db454619-ca6a-4b53-8cac-7a246a8fdc38 tempest-VolumeImageDependencyTests-1965452004 None] Lock "cinder-quobyte-020a670b-b792-4bb8-8cc9-be87c0b03a1f" released by "delete_volume" :: held 0.881s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-db454619-ca6a-4b53-8cac-7a246a8fdc38 tempest-VolumeImageDependencyTests-1965452004 None] Created reservations ['bf4516ea-6573-4204-80b9-8170a871c2ea', '89327a88-a23f-4b67-9083-8ac26f1a4b00', 'c3f6a10a-4251-48ed-a8d6-4ff813396d5e', '51c527b1-1ff5-405c-8c81-7b44eead1e9f'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-db454619-ca6a-4b53-8cac-7a246a8fdc38 tempest-VolumeImageDependencyTests-1965452004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-db454619-ca6a-4b53-8cac-7a246a8fdc38 tempest-VolumeImageDependencyTests-1965452004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-db454619-ca6a-4b53-8cac-7a246a8fdc38 tempest-VolumeImageDependencyTests-1965452004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-db454619-ca6a-4b53-8cac-7a246a8fdc38 tempest-VolumeImageDependencyTests-1965452004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-db454619-ca6a-4b53-8cac-7a246a8fdc38 tempest-VolumeImageDependencyTests-1965452004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-db454619-ca6a-4b53-8cac-7a246a8fdc38 tempest-VolumeImageDependencyTests-1965452004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:51 devstack sudo[105696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:19:51 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8405ff04-fa04-456d-88c5-58e384ab1aeb tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-aa933e3d-f4ef-41ee-8d92-73c09eca8844-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8405ff04-fa04-456d-88c5-58e384ab1aeb tempest-ProjectMemberTests-442300356 None] Lock "cinder-aa933e3d-f4ef-41ee-8d92-73c09eca8844-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8405ff04-fa04-456d-88c5-58e384ab1aeb tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-quobyte-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8405ff04-fa04-456d-88c5-58e384ab1aeb tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8405ff04-fa04-456d-88c5-58e384ab1aeb tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-quobyte-aa933e3d-f4ef-41ee-8d92-73c09eca8844" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8405ff04-fa04-456d-88c5-58e384ab1aeb tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-aa933e3d-f4ef-41ee-8d92-73c09eca8844" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-8405ff04-fa04-456d-88c5-58e384ab1aeb tempest-ProjectMemberTests-442300356 None] Deleting offline snapshot aa933e3d-f4ef-41ee-8d92-73c09eca8844 of volume 34258ee5-5169-4a3a-8d7f-cc63ebffdcfc {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:19:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-8405ff04-fa04-456d-88c5-58e384ab1aeb tempest-ProjectMemberTests-442300356 None] snapshot_file for this snap is: volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc.aa933e3d-f4ef-41ee-8d92-73c09eca8844 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:19:52 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6174f8fb-e3ed-48c8-b27a-c28f11873265]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8405ff04-fa04-456d-88c5-58e384ab1aeb tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc.aa933e3d-f4ef-41ee-8d92-73c09eca8844 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:52 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-18b4200f-f4cd-4461-a47b-7d2de818b315 1073741824" returned: 0 in 0.694s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:52 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-db454619-ca6a-4b53-8cac-7a246a8fdc38 tempest-VolumeImageDependencyTests-1965452004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.488s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:52 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-db454619-ca6a-4b53-8cac-7a246a8fdc38 tempest-VolumeImageDependencyTests-1965452004 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:19:52 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-db454619-ca6a-4b53-8cac-7a246a8fdc38 tempest-VolumeImageDependencyTests-1965452004 None] Deleted volume successfully.
Sep 07 18:19:52 devstack sudo[105703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc.aa933e3d-f4ef-41ee-8d92-73c09eca8844
Sep 07 18:19:52 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-db454619-ca6a-4b53-8cac-7a246a8fdc38 tempest-VolumeImageDependencyTests-1965452004 None] Lock "cinder-020a670b-b792-4bb8-8cc9-be87c0b03a1f-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-18b4200f-f4cd-4461-a47b-7d2de818b315 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:52 devstack sudo[105705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-18b4200f-f4cd-4461-a47b-7d2de818b315
Sep 07 18:19:52 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:52 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-18b4200f-f4cd-4461-a47b-7d2de818b315" returned: 0 in 0.299s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:19:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f203fb57-6fd5-4d58-bc4e-545c0031046e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18b4200f-f4cd-4461-a47b-7d2de818b315', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:52 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff8d95d-c617-421d-9671-7115eebdda40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8405ff04-fa04-456d-88c5-58e384ab1aeb tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc.aa933e3d-f4ef-41ee-8d92-73c09eca8844" returned: 0 in 0.521s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-8405ff04-fa04-456d-88c5-58e384ab1aeb tempest-ProjectMemberTests-442300356 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:19:52 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Volume volume-18b4200f-f4cd-4461-a47b-7d2de818b315 (18b4200f-f4cd-4461-a47b-7d2de818b315): created successfully
Sep 07 18:19:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fff8d95d-c617-421d-9671-7115eebdda40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Flow 'volume_create_manager' (d9f953af-b10f-4dda-9a12-22c81e19a086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:52 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb2188d-84de-486f-9728-eb9daf3c45d2]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8405ff04-fa04-456d-88c5-58e384ab1aeb tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:52 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-1827cb1a-5d9f-48f8-91a3-4992c5a241f7 tempest-ProjectReaderTests-2138437307 None] Created volume successfully.
Sep 07 18:19:52 devstack sudo[105711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc
Sep 07 18:19:52 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:53 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8405ff04-fa04-456d-88c5-58e384ab1aeb tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc" returned: 0 in 0.509s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8405ff04-fa04-456d-88c5-58e384ab1aeb tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc.aa933e3d-f4ef-41ee-8d92-73c09eca8844 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:53 devstack sudo[105716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc.aa933e3d-f4ef-41ee-8d92-73c09eca8844
Sep 07 18:19:53 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:53 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8405ff04-fa04-456d-88c5-58e384ab1aeb tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc.aa933e3d-f4ef-41ee-8d92-73c09eca8844" returned: 0 in 0.480s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8405ff04-fa04-456d-88c5-58e384ab1aeb tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc.aa933e3d-f4ef-41ee-8d92-73c09eca8844 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:53 devstack sudo[105721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc.aa933e3d-f4ef-41ee-8d92-73c09eca8844
Sep 07 18:19:53 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:54 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8405ff04-fa04-456d-88c5-58e384ab1aeb tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc.aa933e3d-f4ef-41ee-8d92-73c09eca8844" returned: 0 in 0.408s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b0a1671c-090c-49b1-980d-a0cfe5d0d16b tempest-ProjectReaderTests-2138437307 None] Acquiring lock "cinder-18b4200f-f4cd-4461-a47b-7d2de818b315-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8405ff04-fa04-456d-88c5-58e384ab1aeb tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-aa933e3d-f4ef-41ee-8d92-73c09eca8844" released by "_delete_snapshot" :: held 2.143s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8405ff04-fa04-456d-88c5-58e384ab1aeb tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc" released by "delete_snapshot" :: held 2.187s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b0a1671c-090c-49b1-980d-a0cfe5d0d16b tempest-ProjectReaderTests-2138437307 None] Lock "cinder-18b4200f-f4cd-4461-a47b-7d2de818b315-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b0a1671c-090c-49b1-980d-a0cfe5d0d16b tempest-ProjectReaderTests-2138437307 None] Acquiring lock "cinder-quobyte-18b4200f-f4cd-4461-a47b-7d2de818b315" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b0a1671c-090c-49b1-980d-a0cfe5d0d16b tempest-ProjectReaderTests-2138437307 None] Lock "cinder-quobyte-18b4200f-f4cd-4461-a47b-7d2de818b315" acquired by "delete_volume" :: waited 0.027s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:54 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ac12d9-4786-4965-aaf4-10a0ed9175c2]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b0a1671c-090c-49b1-980d-a0cfe5d0d16b tempest-ProjectReaderTests-2138437307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-18b4200f-f4cd-4461-a47b-7d2de818b315 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:54 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-8405ff04-fa04-456d-88c5-58e384ab1aeb tempest-ProjectMemberTests-442300356 None] Created reservations ['02cfaf08-b57b-4ea7-a518-7fa5d89ef9ab', '2b124303-0af2-48e4-8f86-92281bace1f9', '4a6a22da-8ff6-4012-a287-9a2a1911e018', 'a8be3647-8dd3-45e5-be3c-0fcd4aed31a6'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:54 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-8405ff04-fa04-456d-88c5-58e384ab1aeb tempest-ProjectMemberTests-442300356 None] Delete snapshot completed successfully.
Sep 07 18:19:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8405ff04-fa04-456d-88c5-58e384ab1aeb tempest-ProjectMemberTests-442300356 None] Lock "cinder-aa933e3d-f4ef-41ee-8d92-73c09eca8844-delete_snapshot" released by "delete_snapshot" :: held 2.515s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:54 devstack sudo[105724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-18b4200f-f4cd-4461-a47b-7d2de818b315
Sep 07 18:19:54 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:54 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b0a1671c-090c-49b1-980d-a0cfe5d0d16b tempest-ProjectReaderTests-2138437307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-18b4200f-f4cd-4461-a47b-7d2de818b315" returned: 0 in 0.430s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b0a1671c-090c-49b1-980d-a0cfe5d0d16b tempest-ProjectReaderTests-2138437307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-18b4200f-f4cd-4461-a47b-7d2de818b315 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:54 devstack sudo[105729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-18b4200f-f4cd-4461-a47b-7d2de818b315
Sep 07 18:19:54 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:55 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b0a1671c-090c-49b1-980d-a0cfe5d0d16b tempest-ProjectReaderTests-2138437307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-18b4200f-f4cd-4461-a47b-7d2de818b315" returned: 0 in 0.272s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b0a1671c-090c-49b1-980d-a0cfe5d0d16b tempest-ProjectReaderTests-2138437307 None] Lock "cinder-quobyte-18b4200f-f4cd-4461-a47b-7d2de818b315" released by "delete_volume" :: held 0.753s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:55 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-b0a1671c-090c-49b1-980d-a0cfe5d0d16b tempest-ProjectReaderTests-2138437307 None] Created reservations ['86dbd149-274e-4617-b5cb-d78b1686c0ba', 'd7710462-49c7-43e2-9d1b-5d6422cf4ea7', 'cb58e498-27cb-43b4-8948-210c5b644a9f', '57b1cc5c-2217-4bed-ae8b-1a1e05578af8'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b0a1671c-090c-49b1-980d-a0cfe5d0d16b tempest-ProjectReaderTests-2138437307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b0a1671c-090c-49b1-980d-a0cfe5d0d16b tempest-ProjectReaderTests-2138437307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b0a1671c-090c-49b1-980d-a0cfe5d0d16b tempest-ProjectReaderTests-2138437307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b0a1671c-090c-49b1-980d-a0cfe5d0d16b tempest-ProjectReaderTests-2138437307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b0a1671c-090c-49b1-980d-a0cfe5d0d16b tempest-ProjectReaderTests-2138437307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b0a1671c-090c-49b1-980d-a0cfe5d0d16b tempest-ProjectReaderTests-2138437307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:55 devstack sudo[105732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:19:55 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9e893c06-b2ef-4c55-82fe-b81bf2165568 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9e893c06-b2ef-4c55-82fe-b81bf2165568 tempest-ProjectMemberTests-442300356 None] Lock "cinder-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9e893c06-b2ef-4c55-82fe-b81bf2165568 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-quobyte-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9e893c06-b2ef-4c55-82fe-b81bf2165568 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc" acquired by "delete_volume" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:55 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b0a1671c-090c-49b1-980d-a0cfe5d0d16b tempest-ProjectReaderTests-2138437307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.358s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:55 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-b0a1671c-090c-49b1-980d-a0cfe5d0d16b tempest-ProjectReaderTests-2138437307 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:19:55 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b93da2c-a820-4236-9646-f04fe9a47aff]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:55 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b0a1671c-090c-49b1-980d-a0cfe5d0d16b tempest-ProjectReaderTests-2138437307 None] Deleted volume successfully.
Sep 07 18:19:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9e893c06-b2ef-4c55-82fe-b81bf2165568 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b0a1671c-090c-49b1-980d-a0cfe5d0d16b tempest-ProjectReaderTests-2138437307 None] Lock "cinder-18b4200f-f4cd-4461-a47b-7d2de818b315-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:55 devstack sudo[105735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc
Sep 07 18:19:55 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:56 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9e893c06-b2ef-4c55-82fe-b81bf2165568 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc" returned: 0 in 0.508s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9e893c06-b2ef-4c55-82fe-b81bf2165568 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:56 devstack sudo[105741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc
Sep 07 18:19:56 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:56 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9e893c06-b2ef-4c55-82fe-b81bf2165568 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc" returned: 0 in 0.400s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9e893c06-b2ef-4c55-82fe-b81bf2165568 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc" released by "delete_volume" :: held 1.018s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Flow 'volume_create_manager' (0796b08a-eafd-458d-a206-007172aa67ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb7d403-d940-438d-b3c6-92b2e5bf619e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efb7d403-d940-438d-b3c6-92b2e5bf619e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a93423b7-d970-4f6b-bc56-f5ae7f5fd20d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b612eceac8f47e6a6322af0d677bc4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:56Z,use_quota=True,user_id='e4da17dd575046a78b76172dd380b062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa1e0d10-bbaf-4970-917a-6086d8d39209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa1e0d10-bbaf-4970-917a-6086d8d39209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22d2602-1af1-49ab-93f2-695239214ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22d2602-1af1-49ab-93f2-695239214ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a93423b7-d970-4f6b-bc56-f5ae7f5fd20d', 'volume_name': 'volume-a93423b7-d970-4f6b-bc56-f5ae7f5fd20d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c3fedad-bbed-4945-80fa-a717a1c35b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c3fedad-bbed-4945-80fa-a717a1c35b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad7e9ac-c49e-4020-a772-4dc1c9bcc048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:56 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Volume a93423b7-d970-4f6b-bc56-f5ae7f5fd20d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a93423b7-d970-4f6b-bc56-f5ae7f5fd20d', 'volume_size': 1}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a93423b7-d970-4f6b-bc56-f5ae7f5fd20d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b612eceac8f47e6a6322af0d677bc4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:56Z,use_quota=True,user_id='e4da17dd575046a78b76172dd380b062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Creating volume a93423b7-d970-4f6b-bc56-f5ae7f5fd20d {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:19:56 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a93423b7-d970-4f6b-bc56-f5ae7f5fd20d 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:19:56 devstack sudo[105745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a93423b7-d970-4f6b-bc56-f5ae7f5fd20d 1073741824
Sep 07 18:19:56 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Flow 'volume_create_manager' (13dcce2d-3eb9-4da6-9645-2c57bcf2dd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144df8ad-377c-46cf-b939-0a96e5c00693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-9e893c06-b2ef-4c55-82fe-b81bf2165568 tempest-ProjectMemberTests-442300356 None] Created reservations ['3d501965-4252-4bec-920a-62c58a10870a', '52fe027f-35e2-4432-b6c0-42604ade8579', '32088c0e-eb9c-436c-a45b-f98a36737bc0', '523c6fa6-da20-4561-9a79-d2668c7b8e73'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144df8ad-377c-46cf-b939-0a96e5c00693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1949971277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea712b69-8d42-43a4-84b5-47565c396e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b8e30667d9491680120f3ae1aaac5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:57Z,use_quota=True,user_id='4c1e7a9ef62d4198bf344d0b36569a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ca9a8f-837c-4657-89cf-0286767bf493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6ca9a8f-837c-4657-89cf-0286767bf493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760676fd-43ea-4448-8fea-7a48c97281b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760676fd-43ea-4448-8fea-7a48c97281b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea712b69-8d42-43a4-84b5-47565c396e5a', 'volume_name': 'volume-ea712b69-8d42-43a4-84b5-47565c396e5a', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc8b4ce-572c-4c72-aa6f-b1a2b20491e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc8b4ce-572c-4c72-aa6f-b1a2b20491e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5e7d3b-68ba-4a2f-a0c9-6f65add47138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:56 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Volume ea712b69-8d42-43a4-84b5-47565c396e5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea712b69-8d42-43a4-84b5-47565c396e5a', 'volume_size': 1}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9e893c06-b2ef-4c55-82fe-b81bf2165568 tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9e893c06-b2ef-4c55-82fe-b81bf2165568 tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9e893c06-b2ef-4c55-82fe-b81bf2165568 tempest-ProjectMemberTests-442300356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9e893c06-b2ef-4c55-82fe-b81bf2165568 tempest-ProjectMemberTests-442300356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9e893c06-b2ef-4c55-82fe-b81bf2165568 tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9e893c06-b2ef-4c55-82fe-b81bf2165568 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:56 devstack sudo[105747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:19:56 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:57 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a93423b7-d970-4f6b-bc56-f5ae7f5fd20d 1073741824" returned: 0 in 0.446s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a93423b7-d970-4f6b-bc56-f5ae7f5fd20d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:57 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9e893c06-b2ef-4c55-82fe-b81bf2165568 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.338s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-9e893c06-b2ef-4c55-82fe-b81bf2165568 tempest-ProjectMemberTests-442300356 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:19:57 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9e893c06-b2ef-4c55-82fe-b81bf2165568 tempest-ProjectMemberTests-442300356 None] Deleted volume successfully.
Sep 07 18:19:57 devstack sudo[105754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a93423b7-d970-4f6b-bc56-f5ae7f5fd20d
Sep 07 18:19:57 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9e893c06-b2ef-4c55-82fe-b81bf2165568 tempest-ProjectMemberTests-442300356 None] Lock "cinder-34258ee5-5169-4a3a-8d7f-cc63ebffdcfc-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:57 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a93423b7-d970-4f6b-bc56-f5ae7f5fd20d" returned: 0 in 0.302s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.696s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1949971277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea712b69-8d42-43a4-84b5-47565c396e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b8e30667d9491680120f3ae1aaac5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:57Z,use_quota=True,user_id='4c1e7a9ef62d4198bf344d0b36569a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Creating volume ea712b69-8d42-43a4-84b5-47565c396e5a {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:19:57 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ea712b69-8d42-43a4-84b5-47565c396e5a 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:57 devstack sudo[105757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ea712b69-8d42-43a4-84b5-47565c396e5a 1073741824
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad7e9ac-c49e-4020-a772-4dc1c9bcc048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a93423b7-d970-4f6b-bc56-f5ae7f5fd20d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:57 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e06660-7da5-4364-a243-36e2488541bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:57 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Volume volume-a93423b7-d970-4f6b-bc56-f5ae7f5fd20d (a93423b7-d970-4f6b-bc56-f5ae7f5fd20d): created successfully
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e06660-7da5-4364-a243-36e2488541bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Flow 'volume_create_manager' (0796b08a-eafd-458d-a206-007172aa67ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:57 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f22f5cf9-c022-47bd-95bd-d7dd798a614f tempest-CinderUnicodeTest-1776155018 None] Created volume successfully.
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Flow 'volume_create_manager' (96e640cf-cf64-4fda-a514-ccfe98c11f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0e06db-9019-418e-be02-068a35e203d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d0e06db-9019-418e-be02-068a35e203d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1760839896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8e9409-bfd1-4e86-868f-4d75b80bb391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e449daccfbab4cd8ba38df886cea84bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:58Z,use_quota=True,user_id='d0204c187bcf4a5ba9582bac88f452df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c9c6e15-7ead-44a6-9387-212866c53bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c9c6e15-7ead-44a6-9387-212866c53bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e89a0f5-8a4d-47f2-91f3-8ab450c8ba49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e89a0f5-8a4d-47f2-91f3-8ab450c8ba49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a8e9409-bfd1-4e86-868f-4d75b80bb391', 'volume_name': 'volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c63ff9c-b06d-499f-87c8-e0dfbbbb8db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c63ff9c-b06d-499f-87c8-e0dfbbbb8db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc10346-5928-4b45-856c-65d946dd134a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:57 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Volume 2a8e9409-bfd1-4e86-868f-4d75b80bb391: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391', 'volume_size': 1}
Sep 07 18:19:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:58 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ea712b69-8d42-43a4-84b5-47565c396e5a 1073741824" returned: 0 in 0.526s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ea712b69-8d42-43a4-84b5-47565c396e5a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:58 devstack sudo[105764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ea712b69-8d42-43a4-84b5-47565c396e5a
Sep 07 18:19:58 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:58 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ea712b69-8d42-43a4-84b5-47565c396e5a" returned: 0 in 0.268s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:19:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.439s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1760839896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8e9409-bfd1-4e86-868f-4d75b80bb391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e449daccfbab4cd8ba38df886cea84bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:58Z,use_quota=True,user_id='d0204c187bcf4a5ba9582bac88f452df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:19:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Creating volume 2a8e9409-bfd1-4e86-868f-4d75b80bb391 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:19:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:19:58 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:19:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5e7d3b-68ba-4a2f-a0c9-6f65add47138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea712b69-8d42-43a4-84b5-47565c396e5a', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:58 devstack sudo[105768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391 1073741824
Sep 07 18:19:58 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0533ed-0559-407a-951e-a1f82a74a535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:58 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Volume volume-ea712b69-8d42-43a4-84b5-47565c396e5a (ea712b69-8d42-43a4-84b5-47565c396e5a): created successfully
Sep 07 18:19:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0533ed-0559-407a-951e-a1f82a74a535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:58 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Flow 'volume_create_manager' (13dcce2d-3eb9-4da6-9645-2c57bcf2dd0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:58 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9043141e-d7a0-42d8-bf0b-1088a89d96ec tempest-ProjectReaderTests-2138437307 None] Created volume successfully.
Sep 07 18:19:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8fd021ca-1c4f-4a9a-90d0-5174ab8d5b18 tempest-ProjectReaderTests-2138437307 None] Acquiring lock "cinder-ea712b69-8d42-43a4-84b5-47565c396e5a-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8fd021ca-1c4f-4a9a-90d0-5174ab8d5b18 tempest-ProjectReaderTests-2138437307 None] Lock "cinder-ea712b69-8d42-43a4-84b5-47565c396e5a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8fd021ca-1c4f-4a9a-90d0-5174ab8d5b18 tempest-ProjectReaderTests-2138437307 None] Acquiring lock "cinder-quobyte-ea712b69-8d42-43a4-84b5-47565c396e5a" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:19:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8fd021ca-1c4f-4a9a-90d0-5174ab8d5b18 tempest-ProjectReaderTests-2138437307 None] Lock "cinder-quobyte-ea712b69-8d42-43a4-84b5-47565c396e5a" acquired by "delete_volume" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:19:58 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f57b5c-f881-4714-b36f-6325786ddc89]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:19:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8fd021ca-1c4f-4a9a-90d0-5174ab8d5b18 tempest-ProjectReaderTests-2138437307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ea712b69-8d42-43a4-84b5-47565c396e5a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:59 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391 1073741824" returned: 0 in 0.623s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:59 devstack sudo[105774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ea712b69-8d42-43a4-84b5-47565c396e5a
Sep 07 18:19:59 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:59 devstack sudo[105776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391
Sep 07 18:19:59 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:19:59 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Flow 'volume_create_manager' (eb7eb261-2a55-4e87-9a57-a68c92317f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a7e08d-79ff-4804-801a-6ba9162f7b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8fd021ca-1c4f-4a9a-90d0-5174ab8d5b18 tempest-ProjectReaderTests-2138437307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ea712b69-8d42-43a4-84b5-47565c396e5a" returned: 0 in 0.489s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8fd021ca-1c4f-4a9a-90d0-5174ab8d5b18 tempest-ProjectReaderTests-2138437307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ea712b69-8d42-43a4-84b5-47565c396e5a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:59 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391" returned: 0 in 0.369s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:59 devstack sudo[105782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ea712b69-8d42-43a4-84b5-47565c396e5a
Sep 07 18:19:59 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a7e08d-79ff-4804-801a-6ba9162f7b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1750181545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68db5d3a-026d-4f0f-a9ad-806600b6b2ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b612eceac8f47e6a6322af0d677bc4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:59Z,use_quota=True,user_id='e4da17dd575046a78b76172dd380b062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82c7e64a-062e-4d8b-822b-8a2877d6512c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82c7e64a-062e-4d8b-822b-8a2877d6512c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a514c2-bf80-4c25-a315-0542e6cf21db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a514c2-bf80-4c25-a315-0542e6cf21db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68db5d3a-026d-4f0f-a9ad-806600b6b2ab', 'volume_name': 'volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78517a04-7dd0-443f-b895-41756763dd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78517a04-7dd0-443f-b895-41756763dd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34bdf82-5255-4948-9ec8-41ff7170b344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:59 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Volume 68db5d3a-026d-4f0f-a9ad-806600b6b2ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab', 'volume_size': 1}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:19:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1750181545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68db5d3a-026d-4f0f-a9ad-806600b6b2ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b612eceac8f47e6a6322af0d677bc4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:19:59Z,use_quota=True,user_id='e4da17dd575046a78b76172dd380b062',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Creating volume 68db5d3a-026d-4f0f-a9ad-806600b6b2ab {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:19:59 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc10346-5928-4b45-856c-65d946dd134a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a3b490-48e5-441e-a5fc-7d7a762523cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:19:59 devstack sudo[105784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab 1073741824
Sep 07 18:19:59 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:19:59 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Volume volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391 (2a8e9409-bfd1-4e86-868f-4d75b80bb391): created successfully
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a3b490-48e5-441e-a5fc-7d7a762523cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Flow 'volume_create_manager' (96e640cf-cf64-4fda-a514-ccfe98c11f2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:19:59 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a854ef03-af47-493c-a667-e0f4329a9ed3 tempest-ProjectMemberTests-442300356 None] Created volume successfully.
Sep 07 18:19:59 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8fd021ca-1c4f-4a9a-90d0-5174ab8d5b18 tempest-ProjectReaderTests-2138437307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-ea712b69-8d42-43a4-84b5-47565c396e5a" returned: 0 in 0.264s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8fd021ca-1c4f-4a9a-90d0-5174ab8d5b18 tempest-ProjectReaderTests-2138437307 None] Lock "cinder-quobyte-ea712b69-8d42-43a4-84b5-47565c396e5a" released by "delete_volume" :: held 0.808s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-8fd021ca-1c4f-4a9a-90d0-5174ab8d5b18 tempest-ProjectReaderTests-2138437307 None] Created reservations ['11b63d85-36d6-4956-9c8a-0d2357fd4d67', '38d2b7eb-7cb9-4842-8c6d-96559fe9e64a', '856f775d-0091-46e2-a5ce-4bc3bbdafb51', '75207a0b-c1f5-4981-b76d-52ceafcb2fc8'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8fd021ca-1c4f-4a9a-90d0-5174ab8d5b18 tempest-ProjectReaderTests-2138437307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8fd021ca-1c4f-4a9a-90d0-5174ab8d5b18 tempest-ProjectReaderTests-2138437307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8fd021ca-1c4f-4a9a-90d0-5174ab8d5b18 tempest-ProjectReaderTests-2138437307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8fd021ca-1c4f-4a9a-90d0-5174ab8d5b18 tempest-ProjectReaderTests-2138437307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8fd021ca-1c4f-4a9a-90d0-5174ab8d5b18 tempest-ProjectReaderTests-2138437307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:19:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8fd021ca-1c4f-4a9a-90d0-5174ab8d5b18 tempest-ProjectReaderTests-2138437307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:19:59 devstack sudo[105790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:19:59 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:00 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab 1073741824" returned: 0 in 0.690s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:00 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8fd021ca-1c4f-4a9a-90d0-5174ab8d5b18 tempest-ProjectReaderTests-2138437307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.412s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-8fd021ca-1c4f-4a9a-90d0-5174ab8d5b18 tempest-ProjectReaderTests-2138437307 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:20:00 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-8fd021ca-1c4f-4a9a-90d0-5174ab8d5b18 tempest-ProjectReaderTests-2138437307 None] Deleted volume successfully.
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8fd021ca-1c4f-4a9a-90d0-5174ab8d5b18 tempest-ProjectReaderTests-2138437307 None] Lock "cinder-ea712b69-8d42-43a4-84b5-47565c396e5a-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:00 devstack sudo[105794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab
Sep 07 18:20:00 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4d04ad4b-5cbc-4350-9504-fd2ebb6972b3 tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:00 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab" returned: 0 in 0.431s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4d04ad4b-5cbc-4350-9504-fd2ebb6972b3 tempest-ProjectMemberTests-442300356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.271s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4d04ad4b-5cbc-4350-9504-fd2ebb6972b3 tempest-ProjectMemberTests-442300356 None] Creating offline snapshot c99580ff-eddf-4bf8-9d00-fe5d04d0c612 of volume 2a8e9409-bfd1-4e86-868f-4d75b80bb391 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a34bdf82-5255-4948-9ec8-41ff7170b344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f1f8f5c-dc8f-45c3-a98b-d641af65ef9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[620c8d8e-ba6c-49c5-9111-144b36f693b4]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4d04ad4b-5cbc-4350-9504-fd2ebb6972b3 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:00 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Volume volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab (68db5d3a-026d-4f0f-a9ad-806600b6b2ab): created successfully
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f1f8f5c-dc8f-45c3-a98b-d641af65ef9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Flow 'volume_create_manager' (eb7eb261-2a55-4e87-9a57-a68c92317f0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:00 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3761c337-9f27-4e16-bdc9-4dee4a9540b0 tempest-CinderUnicodeTest-1776155018 None] Created volume successfully.
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Flow 'volume_create_manager' (0e3f0f35-89ed-446e-879c-adf683619ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26de0626-832d-4706-9f8a-549923def37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:00 devstack sudo[105797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391
Sep 07 18:20:00 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26de0626-832d-4706-9f8a-549923def37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-38921262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c7436b-5edf-4e58-85ca-10a662156e6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b8e30667d9491680120f3ae1aaac5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:01Z,use_quota=True,user_id='4c1e7a9ef62d4198bf344d0b36569a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:00 devstack sudo[105798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:20:00 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cba470c-9107-4865-8d3d-4bd2e9ce01b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cba470c-9107-4865-8d3d-4bd2e9ce01b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ef0e73-d06f-4d05-a986-0b97d5ca735b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ef0e73-d06f-4d05-a986-0b97d5ca735b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65c7436b-5edf-4e58-85ca-10a662156e6c', 'volume_name': 'volume-65c7436b-5edf-4e58-85ca-10a662156e6c', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dad9580-bf80-42b9-ae0e-62982e8414fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dad9580-bf80-42b9-ae0e-62982e8414fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4fc82d-65dd-4bd2-822b-22073080ec85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:00 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Volume 65c7436b-5edf-4e58-85ca-10a662156e6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65c7436b-5edf-4e58-85ca-10a662156e6c', 'volume_size': 1}
Sep 07 18:20:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:01 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4d04ad4b-5cbc-4350-9504-fd2ebb6972b3 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391" returned: 0 in 0.401s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4d04ad4b-5cbc-4350-9504-fd2ebb6972b3 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391.c99580ff-eddf-4bf8-9d00-fe5d04d0c612 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:01 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.309s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:20:01 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:20:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 07 18:20:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread info: [<_MainThread(MainThread, started 137533762306176)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137533650971072)>, <Thread(Thread-3 (stat_writer), started daemon 137533647226880)>, <Thread(Rabbit-heartbeat, started daemon 137533647437120)>, <Thread(Thread-5 (_runner), started daemon 137533648120896)>, <Thread(Thread-7 (_runner), started daemon 137533648182592)>, <Thread(fd_logger, started daemon 137533644336576)>, <Thread(privsep_reader, started daemon 137533643255424)>, <Thread(tpool_thread_0, started daemon 137533635446464)>, <Thread(tpool_thread_1, started daemon 137533627053760)>, <Thread(tpool_thread_2, started daemon 137533618661056)>, <Thread(tpool_thread_3, started daemon 137533610251968)>, <Thread(tpool_thread_4, started daemon 137533601842880)>, <Thread(tpool_thread_5, started daemon 137533593433792)>, <Thread(tpool_thread_6, started daemon 137533585024704)>, <Thread(tpool_thread_7, started daemon 137533576615616)>, <Thread(tpool_thread_8, started daemon 137533568206528)>, <Thread(tpool_thread_9, started daemon 137533559797440)>, <Thread(tpool_thread_10, started daemon 137533551388352)>, <Thread(tpool_thread_11, started daemon 137533542979264)>, <Thread(tpool_thread_12, started daemon 137533534570176)>, <Thread(tpool_thread_13, started daemon 137533526161088)>, <Thread(tpool_thread_14, started daemon 137533517752000)>, <Thread(tpool_thread_15, started daemon 137533509342912)>, <Thread(tpool_thread_16, started daemon 137533500933824)>, <Thread(tpool_thread_17, started daemon 137533492524736)>, <Thread(tpool_thread_18, started daemon 137533484115648)>, <Thread(tpool_thread_19, started daemon 137533475706560)>] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 07 18:20:01 devstack sudo[105806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391.c99580ff-eddf-4bf8-9d00-fe5d04d0c612 1G
Sep 07 18:20:01 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:01 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4d04ad4b-5cbc-4350-9504-fd2ebb6972b3 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391.c99580ff-eddf-4bf8-9d00-fe5d04d0c612 1G" returned: 0 in 0.462s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4d04ad4b-5cbc-4350-9504-fd2ebb6972b3 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391.c99580ff-eddf-4bf8-9d00-fe5d04d0c612 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:01 devstack sudo[105812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391.c99580ff-eddf-4bf8-9d00-fe5d04d0c612
Sep 07 18:20:01 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc135be5-b937-46e0-9825-3661a8d5bbcc tempest-CinderUnicodeTest-1776155018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:02 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4d04ad4b-5cbc-4350-9504-fd2ebb6972b3 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391.c99580ff-eddf-4bf8-9d00-fe5d04d0c612" returned: 0 in 0.386s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:02 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-4d04ad4b-5cbc-4350-9504-fd2ebb6972b3 tempest-ProjectMemberTests-442300356 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391.c99580ff-eddf-4bf8-9d00-fe5d04d0c612 is being set with open permissions: ugo+rw
Sep 07 18:20:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4d04ad4b-5cbc-4350-9504-fd2ebb6972b3 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391.c99580ff-eddf-4bf8-9d00-fe5d04d0c612 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:02 devstack sudo[105817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391.c99580ff-eddf-4bf8-9d00-fe5d04d0c612
Sep 07 18:20:02 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:02 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4d04ad4b-5cbc-4350-9504-fd2ebb6972b3 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391.c99580ff-eddf-4bf8-9d00-fe5d04d0c612" returned: 0 in 0.243s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4d04ad4b-5cbc-4350-9504-fd2ebb6972b3 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:02 devstack sudo[105820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391.info
Sep 07 18:20:02 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:02 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4d04ad4b-5cbc-4350-9504-fd2ebb6972b3 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391.info" returned: 0 in 0.272s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:02 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-4d04ad4b-5cbc-4350-9504-fd2ebb6972b3 tempest-ProjectMemberTests-442300356 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391.info is being set with open permissions: ugo+rw
Sep 07 18:20:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4d04ad4b-5cbc-4350-9504-fd2ebb6972b3 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:02 devstack sudo[105823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391.info
Sep 07 18:20:02 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:02 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4d04ad4b-5cbc-4350-9504-fd2ebb6972b3 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391.info" returned: 0 in 0.291s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4d04ad4b-5cbc-4350-9504-fd2ebb6972b3 tempest-ProjectMemberTests-442300356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.157s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.922s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-38921262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c7436b-5edf-4e58-85ca-10a662156e6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b8e30667d9491680120f3ae1aaac5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:01Z,use_quota=True,user_id='4c1e7a9ef62d4198bf344d0b36569a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:20:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Creating volume 65c7436b-5edf-4e58-85ca-10a662156e6c {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:20:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:02 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:20:02 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:20:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-65c7436b-5edf-4e58-85ca-10a662156e6c 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:02 devstack sudo[105826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-65c7436b-5edf-4e58-85ca-10a662156e6c 1073741824
Sep 07 18:20:02 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:02 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4d04ad4b-5cbc-4350-9504-fd2ebb6972b3 tempest-ProjectMemberTests-442300356 None] Create snapshot completed successfully
Sep 07 18:20:03 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-65c7436b-5edf-4e58-85ca-10a662156e6c 1073741824" returned: 0 in 0.455s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-65c7436b-5edf-4e58-85ca-10a662156e6c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:03 devstack sudo[105832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-65c7436b-5edf-4e58-85ca-10a662156e6c
Sep 07 18:20:03 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:03 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2142a480-4d8e-4a22-b1b1-03d1e0306347 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-c99580ff-eddf-4bf8-9d00-fe5d04d0c612-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-65c7436b-5edf-4e58-85ca-10a662156e6c" returned: 0 in 0.267s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:20:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc135be5-b937-46e0-9825-3661a8d5bbcc tempest-CinderUnicodeTest-1776155018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.836s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a4fc82d-65dd-4bd2-822b-22073080ec85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65c7436b-5edf-4e58-85ca-10a662156e6c', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7458e78f-7164-4316-a929-3159b4ab62ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2142a480-4d8e-4a22-b1b1-03d1e0306347 tempest-ProjectMemberTests-442300356 None] Lock "cinder-c99580ff-eddf-4bf8-9d00-fe5d04d0c612-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2142a480-4d8e-4a22-b1b1-03d1e0306347 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-quobyte-2a8e9409-bfd1-4e86-868f-4d75b80bb391" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-dc135be5-b937-46e0-9825-3661a8d5bbcc tempest-CinderUnicodeTest-1776155018 None] Creating offline snapshot 294dece5-23cd-4be0-b60f-6020e05d518b of volume 68db5d3a-026d-4f0f-a9ad-806600b6b2ab {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:20:03 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Volume volume-65c7436b-5edf-4e58-85ca-10a662156e6c (65c7436b-5edf-4e58-85ca-10a662156e6c): created successfully
Sep 07 18:20:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7458e78f-7164-4316-a929-3159b4ab62ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:03 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Flow 'volume_create_manager' (0e3f0f35-89ed-446e-879c-adf683619ebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2142a480-4d8e-4a22-b1b1-03d1e0306347 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-2a8e9409-bfd1-4e86-868f-4d75b80bb391" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2142a480-4d8e-4a22-b1b1-03d1e0306347 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-quobyte-c99580ff-eddf-4bf8-9d00-fe5d04d0c612" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:03 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[52289476-860b-4a69-a8d5-4c05a02dda2e]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc135be5-b937-46e0-9825-3661a8d5bbcc tempest-CinderUnicodeTest-1776155018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:03 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ea0f18fb-517c-4a42-ba35-cbcdcef57584 tempest-ProjectReaderTests-2138437307 None] Created volume successfully.
Sep 07 18:20:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2142a480-4d8e-4a22-b1b1-03d1e0306347 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-c99580ff-eddf-4bf8-9d00-fe5d04d0c612" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-2142a480-4d8e-4a22-b1b1-03d1e0306347 tempest-ProjectMemberTests-442300356 None] Deleting offline snapshot c99580ff-eddf-4bf8-9d00-fe5d04d0c612 of volume 2a8e9409-bfd1-4e86-868f-4d75b80bb391 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:20:03 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-2142a480-4d8e-4a22-b1b1-03d1e0306347 tempest-ProjectMemberTests-442300356 None] snapshot_file for this snap is: volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391.c99580ff-eddf-4bf8-9d00-fe5d04d0c612 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:20:03 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[04308faf-4381-4bf8-bbd7-829b781a4094]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2142a480-4d8e-4a22-b1b1-03d1e0306347 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391.c99580ff-eddf-4bf8-9d00-fe5d04d0c612 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:03 devstack sudo[105835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab
Sep 07 18:20:03 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:04 devstack sudo[105836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391.c99580ff-eddf-4bf8-9d00-fe5d04d0c612
Sep 07 18:20:04 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4e9f2dcf-0f78-4040-b271-bdf45426427f tempest-ProjectReaderTests-2138437307 None] Acquiring lock "cinder-65c7436b-5edf-4e58-85ca-10a662156e6c-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4e9f2dcf-0f78-4040-b271-bdf45426427f tempest-ProjectReaderTests-2138437307 None] Lock "cinder-65c7436b-5edf-4e58-85ca-10a662156e6c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4e9f2dcf-0f78-4040-b271-bdf45426427f tempest-ProjectReaderTests-2138437307 None] Acquiring lock "cinder-quobyte-65c7436b-5edf-4e58-85ca-10a662156e6c" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4e9f2dcf-0f78-4040-b271-bdf45426427f tempest-ProjectReaderTests-2138437307 None] Lock "cinder-quobyte-65c7436b-5edf-4e58-85ca-10a662156e6c" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:04 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6dee04-566e-4afb-9724-29dea885e923]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4e9f2dcf-0f78-4040-b271-bdf45426427f tempest-ProjectReaderTests-2138437307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-65c7436b-5edf-4e58-85ca-10a662156e6c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:04 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc135be5-b937-46e0-9825-3661a8d5bbcc tempest-CinderUnicodeTest-1776155018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab" returned: 0 in 0.509s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc135be5-b937-46e0-9825-3661a8d5bbcc tempest-CinderUnicodeTest-1776155018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab.294dece5-23cd-4be0-b60f-6020e05d518b 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:04 devstack sudo[105843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab.294dece5-23cd-4be0-b60f-6020e05d518b 1G
Sep 07 18:20:04 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:04 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2142a480-4d8e-4a22-b1b1-03d1e0306347 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391.c99580ff-eddf-4bf8-9d00-fe5d04d0c612" returned: 0 in 0.540s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-2142a480-4d8e-4a22-b1b1-03d1e0306347 tempest-ProjectMemberTests-442300356 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:20:04 devstack sudo[105842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-65c7436b-5edf-4e58-85ca-10a662156e6c
Sep 07 18:20:04 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:04 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3412a0-9582-4064-828b-2a0ee1110efd]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2142a480-4d8e-4a22-b1b1-03d1e0306347 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:04 devstack sudo[105849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391
Sep 07 18:20:04 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:04 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4e9f2dcf-0f78-4040-b271-bdf45426427f tempest-ProjectReaderTests-2138437307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-65c7436b-5edf-4e58-85ca-10a662156e6c" returned: 0 in 0.463s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4e9f2dcf-0f78-4040-b271-bdf45426427f tempest-ProjectReaderTests-2138437307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-65c7436b-5edf-4e58-85ca-10a662156e6c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:04 devstack sudo[105861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-65c7436b-5edf-4e58-85ca-10a662156e6c
Sep 07 18:20:04 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:04 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc135be5-b937-46e0-9825-3661a8d5bbcc tempest-CinderUnicodeTest-1776155018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab.294dece5-23cd-4be0-b60f-6020e05d518b 1G" returned: 0 in 0.511s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc135be5-b937-46e0-9825-3661a8d5bbcc tempest-CinderUnicodeTest-1776155018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab.294dece5-23cd-4be0-b60f-6020e05d518b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:04 devstack sudo[105863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab.294dece5-23cd-4be0-b60f-6020e05d518b
Sep 07 18:20:04 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:04 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2142a480-4d8e-4a22-b1b1-03d1e0306347 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391" returned: 0 in 0.534s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2142a480-4d8e-4a22-b1b1-03d1e0306347 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391.c99580ff-eddf-4bf8-9d00-fe5d04d0c612 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:04 devstack sudo[105868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391.c99580ff-eddf-4bf8-9d00-fe5d04d0c612
Sep 07 18:20:04 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:05 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4e9f2dcf-0f78-4040-b271-bdf45426427f tempest-ProjectReaderTests-2138437307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-65c7436b-5edf-4e58-85ca-10a662156e6c" returned: 0 in 0.334s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4e9f2dcf-0f78-4040-b271-bdf45426427f tempest-ProjectReaderTests-2138437307 None] Lock "cinder-quobyte-65c7436b-5edf-4e58-85ca-10a662156e6c" released by "delete_volume" :: held 0.850s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:05 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-4e9f2dcf-0f78-4040-b271-bdf45426427f tempest-ProjectReaderTests-2138437307 None] Created reservations ['d47283e6-522a-43c1-982f-182c18413ba5', 'f382c0e4-f60e-4841-a668-22acf30d445e', '729405b6-de0b-4e49-a7f5-611774790652', 'bb471f89-3ad0-4341-9422-ce46d32536c2'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:05 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc135be5-b937-46e0-9825-3661a8d5bbcc tempest-CinderUnicodeTest-1776155018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab.294dece5-23cd-4be0-b60f-6020e05d518b" returned: 0 in 0.447s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:05 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-dc135be5-b937-46e0-9825-3661a8d5bbcc tempest-CinderUnicodeTest-1776155018 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab.294dece5-23cd-4be0-b60f-6020e05d518b is being set with open permissions: ugo+rw
Sep 07 18:20:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc135be5-b937-46e0-9825-3661a8d5bbcc tempest-CinderUnicodeTest-1776155018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab.294dece5-23cd-4be0-b60f-6020e05d518b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:05 devstack sudo[105875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab.294dece5-23cd-4be0-b60f-6020e05d518b
Sep 07 18:20:05 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4e9f2dcf-0f78-4040-b271-bdf45426427f tempest-ProjectReaderTests-2138437307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4e9f2dcf-0f78-4040-b271-bdf45426427f tempest-ProjectReaderTests-2138437307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4e9f2dcf-0f78-4040-b271-bdf45426427f tempest-ProjectReaderTests-2138437307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:05 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4e9f2dcf-0f78-4040-b271-bdf45426427f tempest-ProjectReaderTests-2138437307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4e9f2dcf-0f78-4040-b271-bdf45426427f tempest-ProjectReaderTests-2138437307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4e9f2dcf-0f78-4040-b271-bdf45426427f tempest-ProjectReaderTests-2138437307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:05 devstack sudo[105878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:20:05 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:05 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2142a480-4d8e-4a22-b1b1-03d1e0306347 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391.c99580ff-eddf-4bf8-9d00-fe5d04d0c612" returned: 0 in 0.570s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2142a480-4d8e-4a22-b1b1-03d1e0306347 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391.c99580ff-eddf-4bf8-9d00-fe5d04d0c612 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:05 devstack sudo[105882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391.c99580ff-eddf-4bf8-9d00-fe5d04d0c612
Sep 07 18:20:05 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:05 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc135be5-b937-46e0-9825-3661a8d5bbcc tempest-CinderUnicodeTest-1776155018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab.294dece5-23cd-4be0-b60f-6020e05d518b" returned: 0 in 0.382s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:05 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4e9f2dcf-0f78-4040-b271-bdf45426427f tempest-ProjectReaderTests-2138437307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.398s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:05 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-4e9f2dcf-0f78-4040-b271-bdf45426427f tempest-ProjectReaderTests-2138437307 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:20:05 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4e9f2dcf-0f78-4040-b271-bdf45426427f tempest-ProjectReaderTests-2138437307 None] Deleted volume successfully.
Sep 07 18:20:05 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc135be5-b937-46e0-9825-3661a8d5bbcc tempest-CinderUnicodeTest-1776155018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:05 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-4e9f2dcf-0f78-4040-b271-bdf45426427f tempest-ProjectReaderTests-2138437307 None] Lock "cinder-65c7436b-5edf-4e58-85ca-10a662156e6c-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:05 devstack sudo[105885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab.info
Sep 07 18:20:05 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:06 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:06 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc135be5-b937-46e0-9825-3661a8d5bbcc tempest-CinderUnicodeTest-1776155018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab.info" returned: 0 in 0.402s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:06 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-dc135be5-b937-46e0-9825-3661a8d5bbcc tempest-CinderUnicodeTest-1776155018 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab.info is being set with open permissions: ugo+rw
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc135be5-b937-46e0-9825-3661a8d5bbcc tempest-CinderUnicodeTest-1776155018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2142a480-4d8e-4a22-b1b1-03d1e0306347 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391.c99580ff-eddf-4bf8-9d00-fe5d04d0c612" returned: 0 in 0.608s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:06 devstack sudo[105889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab.info
Sep 07 18:20:06 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2142a480-4d8e-4a22-b1b1-03d1e0306347 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-c99580ff-eddf-4bf8-9d00-fe5d04d0c612" released by "_delete_snapshot" :: held 2.402s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2142a480-4d8e-4a22-b1b1-03d1e0306347 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-2a8e9409-bfd1-4e86-868f-4d75b80bb391" released by "delete_snapshot" :: held 2.474s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Flow 'volume_create_manager' (8c58744e-a9ef-444f-b772-3304e590bbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2d6e596-98c0-41f8-b247-ecd51cb5a25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2d6e596-98c0-41f8-b247-ecd51cb5a25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1794021835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b4fdf73-a733-482d-876d-9aee3bca8ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b8e30667d9491680120f3ae1aaac5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:06Z,use_quota=True,user_id='4c1e7a9ef62d4198bf344d0b36569a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (778a376a-c999-4c2c-ad0d-8112ded72021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (778a376a-c999-4c2c-ad0d-8112ded72021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284afde8-0336-4cd8-a971-552a9c5b1d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284afde8-0336-4cd8-a971-552a9c5b1d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b4fdf73-a733-482d-876d-9aee3bca8ccb', 'volume_name': 'volume-7b4fdf73-a733-482d-876d-9aee3bca8ccb', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aece1757-c4ba-4dc4-9dab-6692d43380ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aece1757-c4ba-4dc4-9dab-6692d43380ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d23212c-2f70-494e-882c-07d6a37451b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:06 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Volume 7b4fdf73-a733-482d-876d-9aee3bca8ccb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b4fdf73-a733-482d-876d-9aee3bca8ccb', 'volume_size': 1}
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-2142a480-4d8e-4a22-b1b1-03d1e0306347 tempest-ProjectMemberTests-442300356 None] Created reservations ['dab53fd6-242c-4b50-9114-0c690e912d65', '46f9f87c-ec30-4dae-baf8-d8bb0350af43', '5a5234d3-0b90-4e0e-a7c9-1e88d97a8d73', '46433dfb-ed1a-4f89-bb39-a4d1a8c53b6f'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:06 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-dc135be5-b937-46e0-9825-3661a8d5bbcc tempest-CinderUnicodeTest-1776155018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab.info" returned: 0 in 0.391s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-dc135be5-b937-46e0-9825-3661a8d5bbcc tempest-CinderUnicodeTest-1776155018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.863s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.100s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1794021835',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b4fdf73-a733-482d-876d-9aee3bca8ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65b8e30667d9491680120f3ae1aaac5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:06Z,use_quota=True,user_id='4c1e7a9ef62d4198bf344d0b36569a5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Creating volume 7b4fdf73-a733-482d-876d-9aee3bca8ccb {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:20:06 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7b4fdf73-a733-482d-876d-9aee3bca8ccb 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:06 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2142a480-4d8e-4a22-b1b1-03d1e0306347 tempest-ProjectMemberTests-442300356 None] Delete snapshot completed successfully.
Sep 07 18:20:06 devstack sudo[105893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7b4fdf73-a733-482d-876d-9aee3bca8ccb 1073741824
Sep 07 18:20:06 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-2142a480-4d8e-4a22-b1b1-03d1e0306347 tempest-ProjectMemberTests-442300356 None] Lock "cinder-c99580ff-eddf-4bf8-9d00-fe5d04d0c612-delete_snapshot" released by "delete_snapshot" :: held 2.879s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:06 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-dc135be5-b937-46e0-9825-3661a8d5bbcc tempest-CinderUnicodeTest-1776155018 None] Create snapshot completed successfully
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d980b81c-b417-4b36-ae0d-b8d428be8612 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-2a8e9409-bfd1-4e86-868f-4d75b80bb391-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d980b81c-b417-4b36-ae0d-b8d428be8612 tempest-ProjectMemberTests-442300356 None] Lock "cinder-2a8e9409-bfd1-4e86-868f-4d75b80bb391-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:06 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d980b81c-b417-4b36-ae0d-b8d428be8612 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-quobyte-2a8e9409-bfd1-4e86-868f-4d75b80bb391" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d980b81c-b417-4b36-ae0d-b8d428be8612 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-2a8e9409-bfd1-4e86-868f-4d75b80bb391" acquired by "delete_volume" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[37706520-e804-485e-bb4d-a0245db8f306]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d980b81c-b417-4b36-ae0d-b8d428be8612 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:07 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7b4fdf73-a733-482d-876d-9aee3bca8ccb 1073741824" returned: 0 in 0.595s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7b4fdf73-a733-482d-876d-9aee3bca8ccb {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7c7c392a-91a0-48c7-a964-bf759c3dacd9 tempest-CinderUnicodeTest-1776155018 None] Acquiring lock "cinder-294dece5-23cd-4be0-b60f-6020e05d518b-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:07 devstack sudo[105899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391
Sep 07 18:20:07 devstack sudo[105900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7b4fdf73-a733-482d-876d-9aee3bca8ccb
Sep 07 18:20:07 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:07 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7c7c392a-91a0-48c7-a964-bf759c3dacd9 tempest-CinderUnicodeTest-1776155018 None] Lock "cinder-294dece5-23cd-4be0-b60f-6020e05d518b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7c7c392a-91a0-48c7-a964-bf759c3dacd9 tempest-CinderUnicodeTest-1776155018 None] Acquiring lock "cinder-quobyte-68db5d3a-026d-4f0f-a9ad-806600b6b2ab" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7c7c392a-91a0-48c7-a964-bf759c3dacd9 tempest-CinderUnicodeTest-1776155018 None] Lock "cinder-quobyte-68db5d3a-026d-4f0f-a9ad-806600b6b2ab" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7c7c392a-91a0-48c7-a964-bf759c3dacd9 tempest-CinderUnicodeTest-1776155018 None] Acquiring lock "cinder-quobyte-294dece5-23cd-4be0-b60f-6020e05d518b" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7c7c392a-91a0-48c7-a964-bf759c3dacd9 tempest-CinderUnicodeTest-1776155018 None] Lock "cinder-quobyte-294dece5-23cd-4be0-b60f-6020e05d518b" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-7c7c392a-91a0-48c7-a964-bf759c3dacd9 tempest-CinderUnicodeTest-1776155018 None] Deleting offline snapshot 294dece5-23cd-4be0-b60f-6020e05d518b of volume 68db5d3a-026d-4f0f-a9ad-806600b6b2ab {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-7c7c392a-91a0-48c7-a964-bf759c3dacd9 tempest-CinderUnicodeTest-1776155018 None] snapshot_file for this snap is: volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab.294dece5-23cd-4be0-b60f-6020e05d518b {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2fdcae-e608-4a57-bfd3-86b30d7e0259]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c7c392a-91a0-48c7-a964-bf759c3dacd9 tempest-CinderUnicodeTest-1776155018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab.294dece5-23cd-4be0-b60f-6020e05d518b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Flow 'volume_create_manager' (fdf192b8-d116-4fd2-983a-90cf8ee748c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8cc3c86-6833-4b0b-b20c-3f74b9005b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8cc3c86-6833-4b0b-b20c-3f74b9005b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-597295583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93b408c4-b38a-487d-a6ea-63218436fa72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb94d13422a046e0a2b9ca88601fb5c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:07Z,use_quota=True,user_id='a08bd25b184445a18d113b39239d107c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (722fe390-a482-4cdd-80d4-d86dc92c4b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (722fe390-a482-4cdd-80d4-d86dc92c4b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eed1b7d-d9c5-4ad2-a863-ac5cce9ed074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eed1b7d-d9c5-4ad2-a863-ac5cce9ed074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93b408c4-b38a-487d-a6ea-63218436fa72', 'volume_name': 'volume-93b408c4-b38a-487d-a6ea-63218436fa72', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c0665ee-1207-438a-aa2b-055869040bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c0665ee-1207-438a-aa2b-055869040bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7bd92c2-eb0f-49d0-934c-d7fb0b34c457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:07 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Volume 93b408c4-b38a-487d-a6ea-63218436fa72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93b408c4-b38a-487d-a6ea-63218436fa72', 'volume_size': 1}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:07 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7b4fdf73-a733-482d-876d-9aee3bca8ccb" returned: 0 in 0.313s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:07 devstack sudo[105903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab.294dece5-23cd-4be0-b60f-6020e05d518b
Sep 07 18:20:07 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.026s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-597295583',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93b408c4-b38a-487d-a6ea-63218436fa72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb94d13422a046e0a2b9ca88601fb5c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:07Z,use_quota=True,user_id='a08bd25b184445a18d113b39239d107c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Creating volume 93b408c4-b38a-487d-a6ea-63218436fa72 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:20:07 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:07 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d980b81c-b417-4b36-ae0d-b8d428be8612 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391" returned: 0 in 0.451s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d980b81c-b417-4b36-ae0d-b8d428be8612 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:07 devstack sudo[105909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72 1073741824
Sep 07 18:20:07 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d23212c-2f70-494e-882c-07d6a37451b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b4fdf73-a733-482d-876d-9aee3bca8ccb', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e65f65c3-82bd-421c-b3e5-4ed7528615c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:07 devstack sudo[105910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391
Sep 07 18:20:07 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:07 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Volume volume-7b4fdf73-a733-482d-876d-9aee3bca8ccb (7b4fdf73-a733-482d-876d-9aee3bca8ccb): created successfully
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e65f65c3-82bd-421c-b3e5-4ed7528615c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Flow 'volume_create_manager' (8c58744e-a9ef-444f-b772-3304e590bbb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:07 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-da0dca91-dbf6-4771-9539-b8c708a8ea25 tempest-ProjectReaderTests-2138437307 None] Created volume successfully.
Sep 07 18:20:07 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c7c392a-91a0-48c7-a964-bf759c3dacd9 tempest-CinderUnicodeTest-1776155018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab.294dece5-23cd-4be0-b60f-6020e05d518b" returned: 0 in 0.412s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-7c7c392a-91a0-48c7-a964-bf759c3dacd9 tempest-CinderUnicodeTest-1776155018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8ad28e-5874-4c22-b5aa-235e9febb564]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c7c392a-91a0-48c7-a964-bf759c3dacd9 tempest-CinderUnicodeTest-1776155018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:07 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d980b81c-b417-4b36-ae0d-b8d428be8612 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-2a8e9409-bfd1-4e86-868f-4d75b80bb391" returned: 0 in 0.304s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d980b81c-b417-4b36-ae0d-b8d428be8612 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-2a8e9409-bfd1-4e86-868f-4d75b80bb391" released by "delete_volume" :: held 0.842s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-d980b81c-b417-4b36-ae0d-b8d428be8612 tempest-ProjectMemberTests-442300356 None] Created reservations ['2d479d08-4453-47cc-8287-9c9650cc2868', 'c8ba34f8-f337-48b7-8834-054bffd52daf', '4962a651-38ba-4050-b964-34155354ae06', 'c6f8a0ce-e562-4901-ac9d-53ea616fb4a5'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:07 devstack sudo[105921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab
Sep 07 18:20:07 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:07 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72 1073741824" returned: 0 in 0.475s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d980b81c-b417-4b36-ae0d-b8d428be8612 tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d980b81c-b417-4b36-ae0d-b8d428be8612 tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:07 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d980b81c-b417-4b36-ae0d-b8d428be8612 tempest-ProjectMemberTests-442300356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d980b81c-b417-4b36-ae0d-b8d428be8612 tempest-ProjectMemberTests-442300356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d980b81c-b417-4b36-ae0d-b8d428be8612 tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d980b81c-b417-4b36-ae0d-b8d428be8612 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:08 devstack sudo[105925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:20:08 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:08 devstack sudo[105927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72
Sep 07 18:20:08 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:08 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c7c392a-91a0-48c7-a964-bf759c3dacd9 tempest-CinderUnicodeTest-1776155018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab" returned: 0 in 0.425s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c7c392a-91a0-48c7-a964-bf759c3dacd9 tempest-CinderUnicodeTest-1776155018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab.294dece5-23cd-4be0-b60f-6020e05d518b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:08 devstack sudo[105933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab.294dece5-23cd-4be0-b60f-6020e05d518b
Sep 07 18:20:08 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:08 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d980b81c-b417-4b36-ae0d-b8d428be8612 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.347s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-d980b81c-b417-4b36-ae0d-b8d428be8612 tempest-ProjectMemberTests-442300356 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:20:08 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d980b81c-b417-4b36-ae0d-b8d428be8612 tempest-ProjectMemberTests-442300356 None] Deleted volume successfully.
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d980b81c-b417-4b36-ae0d-b8d428be8612 tempest-ProjectMemberTests-442300356 None] Lock "cinder-2a8e9409-bfd1-4e86-868f-4d75b80bb391-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:08 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72" returned: 0 in 0.396s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7bd92c2-eb0f-49d0-934c-d7fb0b34c457) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93b408c4-b38a-487d-a6ea-63218436fa72', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f5e459b-109e-4e4f-bc50-403313ca2004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-596eefce-59b1-42b9-b10d-86450c317543 tempest-ProjectReaderTests-2138437307 None] Acquiring lock "cinder-7b4fdf73-a733-482d-876d-9aee3bca8ccb-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:08 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Volume volume-93b408c4-b38a-487d-a6ea-63218436fa72 (93b408c4-b38a-487d-a6ea-63218436fa72): created successfully
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f5e459b-109e-4e4f-bc50-403313ca2004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Flow 'volume_create_manager' (fdf192b8-d116-4fd2-983a-90cf8ee748c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-596eefce-59b1-42b9-b10d-86450c317543 tempest-ProjectReaderTests-2138437307 None] Lock "cinder-7b4fdf73-a733-482d-876d-9aee3bca8ccb-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:08 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9d9026b4-62bd-4968-af0a-90c7225f4e47 tempest-SnapshotDependencyTests-1803193356 None] Created volume successfully.
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-596eefce-59b1-42b9-b10d-86450c317543 tempest-ProjectReaderTests-2138437307 None] Acquiring lock "cinder-quobyte-7b4fdf73-a733-482d-876d-9aee3bca8ccb" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-596eefce-59b1-42b9-b10d-86450c317543 tempest-ProjectReaderTests-2138437307 None] Lock "cinder-quobyte-7b4fdf73-a733-482d-876d-9aee3bca8ccb" acquired by "delete_volume" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd35172-6a76-47bf-bc6d-115230e51f3c]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-596eefce-59b1-42b9-b10d-86450c317543 tempest-ProjectReaderTests-2138437307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7b4fdf73-a733-482d-876d-9aee3bca8ccb {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Flow 'volume_create_manager' (a274ff05-026c-4911-943c-ade57e408551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef87e2aa-12bc-4ed7-9892-22dbb351e077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef87e2aa-12bc-4ed7-9892-22dbb351e077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1045077468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b894f0-45fe-471b-bc8e-ae2fc0e54fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e449daccfbab4cd8ba38df886cea84bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:09Z,use_quota=True,user_id='d0204c187bcf4a5ba9582bac88f452df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9e3a99-52ee-4661-b219-87e48e91fc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:08 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a9e3a99-52ee-4661-b219-87e48e91fc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb81185-ec30-49bf-84aa-9e866a4b4e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb81185-ec30-49bf-84aa-9e866a4b4e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20b894f0-45fe-471b-bc8e-ae2fc0e54fbc', 'volume_name': 'volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:08 devstack sudo[105939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7b4fdf73-a733-482d-876d-9aee3bca8ccb
Sep 07 18:20:08 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3517f774-2653-4d18-a220-747aaa8485fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3517f774-2653-4d18-a220-747aaa8485fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b42b402-3e4e-45c6-9457-5d56aca85095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:08 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Volume 20b894f0-45fe-471b-bc8e-ae2fc0e54fbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc', 'volume_size': 1}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1045077468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20b894f0-45fe-471b-bc8e-ae2fc0e54fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e449daccfbab4cd8ba38df886cea84bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:09Z,use_quota=True,user_id='d0204c187bcf4a5ba9582bac88f452df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Creating volume 20b894f0-45fe-471b-bc8e-ae2fc0e54fbc {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:20:08 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c7c392a-91a0-48c7-a964-bf759c3dacd9 tempest-CinderUnicodeTest-1776155018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab.294dece5-23cd-4be0-b60f-6020e05d518b" returned: 0 in 0.584s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c7c392a-91a0-48c7-a964-bf759c3dacd9 tempest-CinderUnicodeTest-1776155018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab.294dece5-23cd-4be0-b60f-6020e05d518b {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:08 devstack sudo[105942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc 1073741824
Sep 07 18:20:08 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:08 devstack sudo[105943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab.294dece5-23cd-4be0-b60f-6020e05d518b
Sep 07 18:20:08 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:09 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-596eefce-59b1-42b9-b10d-86450c317543 tempest-ProjectReaderTests-2138437307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7b4fdf73-a733-482d-876d-9aee3bca8ccb" returned: 0 in 0.363s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-596eefce-59b1-42b9-b10d-86450c317543 tempest-ProjectReaderTests-2138437307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7b4fdf73-a733-482d-876d-9aee3bca8ccb {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:09 devstack sudo[105951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7b4fdf73-a733-482d-876d-9aee3bca8ccb
Sep 07 18:20:09 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:09 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-7c7c392a-91a0-48c7-a964-bf759c3dacd9 tempest-CinderUnicodeTest-1776155018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab.294dece5-23cd-4be0-b60f-6020e05d518b" returned: 0 in 0.277s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7c7c392a-91a0-48c7-a964-bf759c3dacd9 tempest-CinderUnicodeTest-1776155018 None] Lock "cinder-quobyte-294dece5-23cd-4be0-b60f-6020e05d518b" released by "_delete_snapshot" :: held 1.812s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7c7c392a-91a0-48c7-a964-bf759c3dacd9 tempest-CinderUnicodeTest-1776155018 None] Lock "cinder-quobyte-68db5d3a-026d-4f0f-a9ad-806600b6b2ab" released by "delete_snapshot" :: held 1.853s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-7c7c392a-91a0-48c7-a964-bf759c3dacd9 tempest-CinderUnicodeTest-1776155018 None] Created reservations ['99642590-4dcf-4a24-85f5-84e509466edf', 'ddf76ae3-ac8a-42c2-830d-8498044e2936', 'b56217fc-50c3-49f7-9772-507c8e0d2704', '95ac3fca-3408-44d3-ad24-c9087ea9a81b'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:09 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc 1073741824" returned: 0 in 0.447s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:09 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-7c7c392a-91a0-48c7-a964-bf759c3dacd9 tempest-CinderUnicodeTest-1776155018 None] Delete snapshot completed successfully.
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-7c7c392a-91a0-48c7-a964-bf759c3dacd9 tempest-CinderUnicodeTest-1776155018 None] Lock "cinder-294dece5-23cd-4be0-b60f-6020e05d518b-delete_snapshot" released by "delete_snapshot" :: held 2.015s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:09 devstack sudo[105956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc
Sep 07 18:20:09 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:09 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-596eefce-59b1-42b9-b10d-86450c317543 tempest-ProjectReaderTests-2138437307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7b4fdf73-a733-482d-876d-9aee3bca8ccb" returned: 0 in 0.305s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-596eefce-59b1-42b9-b10d-86450c317543 tempest-ProjectReaderTests-2138437307 None] Lock "cinder-quobyte-7b4fdf73-a733-482d-876d-9aee3bca8ccb" released by "delete_volume" :: held 0.715s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-596eefce-59b1-42b9-b10d-86450c317543 tempest-ProjectReaderTests-2138437307 None] Created reservations ['e05340d2-53d8-4c96-98f7-bbb913c5898b', 'eb03f86d-0a9e-429e-9747-6176e13576ff', 'adf7cec4-ea99-4171-9084-27813d07fb83', 'cf1c1075-0840-41a0-9605-bc7d9778113e'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ce0a6b53-efe4-4f1d-b34b-b65336da1c74 tempest-CinderUnicodeTest-1776155018 None] Acquiring lock "cinder-68db5d3a-026d-4f0f-a9ad-806600b6b2ab-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ce0a6b53-efe4-4f1d-b34b-b65336da1c74 tempest-CinderUnicodeTest-1776155018 None] Lock "cinder-68db5d3a-026d-4f0f-a9ad-806600b6b2ab-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-596eefce-59b1-42b9-b10d-86450c317543 tempest-ProjectReaderTests-2138437307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-596eefce-59b1-42b9-b10d-86450c317543 tempest-ProjectReaderTests-2138437307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-596eefce-59b1-42b9-b10d-86450c317543 tempest-ProjectReaderTests-2138437307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:09 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-596eefce-59b1-42b9-b10d-86450c317543 tempest-ProjectReaderTests-2138437307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-596eefce-59b1-42b9-b10d-86450c317543 tempest-ProjectReaderTests-2138437307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-596eefce-59b1-42b9-b10d-86450c317543 tempest-ProjectReaderTests-2138437307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc" returned: 0 in 0.312s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:09 devstack sudo[105959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b42b402-3e4e-45c6-9457-5d56aca85095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:09 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ffe80a0-efbc-404d-914f-37e0b501c4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:09 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Volume volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc (20b894f0-45fe-471b-bc8e-ae2fc0e54fbc): created successfully
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ffe80a0-efbc-404d-914f-37e0b501c4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Flow 'volume_create_manager' (a274ff05-026c-4911-943c-ade57e408551) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ce0a6b53-efe4-4f1d-b34b-b65336da1c74 tempest-CinderUnicodeTest-1776155018 None] Acquiring lock "cinder-quobyte-68db5d3a-026d-4f0f-a9ad-806600b6b2ab" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:09 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-4b2288ba-802f-4769-929b-c2e964f8a3fe tempest-ProjectMemberTests-442300356 None] Created volume successfully.
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ce0a6b53-efe4-4f1d-b34b-b65336da1c74 tempest-CinderUnicodeTest-1776155018 None] Lock "cinder-quobyte-68db5d3a-026d-4f0f-a9ad-806600b6b2ab" acquired by "delete_volume" :: waited 0.027s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6cac6a35-208e-4014-8d2f-593238a7e35e tempest-SnapshotDependencyTests-1803193356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6cac6a35-208e-4014-8d2f-593238a7e35e tempest-SnapshotDependencyTests-1803193356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-6cac6a35-208e-4014-8d2f-593238a7e35e tempest-SnapshotDependencyTests-1803193356 None] Creating offline snapshot 7f49d393-7bd0-4f11-ab7e-42025b951640 of volume 93b408c4-b38a-487d-a6ea-63218436fa72 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7243624d-4624-405a-a31e-a4a9b26be303]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ce0a6b53-efe4-4f1d-b34b-b65336da1c74 tempest-CinderUnicodeTest-1776155018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a177cdb2-2dcb-45b3-a16c-0058b223c2c0]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cac6a35-208e-4014-8d2f-593238a7e35e tempest-SnapshotDependencyTests-1803193356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:09 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-596eefce-59b1-42b9-b10d-86450c317543 tempest-ProjectReaderTests-2138437307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.336s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-596eefce-59b1-42b9-b10d-86450c317543 tempest-ProjectReaderTests-2138437307 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:20:09 devstack sudo[105961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab
Sep 07 18:20:09 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:09 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-596eefce-59b1-42b9-b10d-86450c317543 tempest-ProjectReaderTests-2138437307 None] Deleted volume successfully.
Sep 07 18:20:09 devstack sudo[105962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72
Sep 07 18:20:09 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-596eefce-59b1-42b9-b10d-86450c317543 tempest-ProjectReaderTests-2138437307 None] Lock "cinder-7b4fdf73-a733-482d-876d-9aee3bca8ccb-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:10 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ce0a6b53-efe4-4f1d-b34b-b65336da1c74 tempest-CinderUnicodeTest-1776155018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab" returned: 0 in 0.447s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ce0a6b53-efe4-4f1d-b34b-b65336da1c74 tempest-CinderUnicodeTest-1776155018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:10 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cac6a35-208e-4014-8d2f-593238a7e35e tempest-SnapshotDependencyTests-1803193356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72" returned: 0 in 0.437s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cac6a35-208e-4014-8d2f-593238a7e35e tempest-SnapshotDependencyTests-1803193356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.7f49d393-7bd0-4f11-ab7e-42025b951640 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:10 devstack sudo[105973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab
Sep 07 18:20:10 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:10 devstack sudo[105974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.7f49d393-7bd0-4f11-ab7e-42025b951640 1G
Sep 07 18:20:10 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:10 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ce0a6b53-efe4-4f1d-b34b-b65336da1c74 tempest-CinderUnicodeTest-1776155018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-68db5d3a-026d-4f0f-a9ad-806600b6b2ab" returned: 0 in 0.292s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ce0a6b53-efe4-4f1d-b34b-b65336da1c74 tempest-CinderUnicodeTest-1776155018 None] Lock "cinder-quobyte-68db5d3a-026d-4f0f-a9ad-806600b6b2ab" released by "delete_volume" :: held 0.826s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:10 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-ce0a6b53-efe4-4f1d-b34b-b65336da1c74 tempest-CinderUnicodeTest-1776155018 None] Created reservations ['247ac51e-42a3-433c-bd33-f2203c880b8b', 'cf37d24c-d68b-4f38-991f-92793b8e60e2', 'ae398f9e-3b7f-469d-9b15-bf657422eed7', '4bc4dce2-2827-4440-836a-e18406495210'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ce0a6b53-efe4-4f1d-b34b-b65336da1c74 tempest-CinderUnicodeTest-1776155018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ce0a6b53-efe4-4f1d-b34b-b65336da1c74 tempest-CinderUnicodeTest-1776155018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ce0a6b53-efe4-4f1d-b34b-b65336da1c74 tempest-CinderUnicodeTest-1776155018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ce0a6b53-efe4-4f1d-b34b-b65336da1c74 tempest-CinderUnicodeTest-1776155018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ce0a6b53-efe4-4f1d-b34b-b65336da1c74 tempest-CinderUnicodeTest-1776155018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ce0a6b53-efe4-4f1d-b34b-b65336da1c74 tempest-CinderUnicodeTest-1776155018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:10 devstack sudo[106018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:20:10 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:10 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cac6a35-208e-4014-8d2f-593238a7e35e tempest-SnapshotDependencyTests-1803193356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.7f49d393-7bd0-4f11-ab7e-42025b951640 1G" returned: 0 in 0.555s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cac6a35-208e-4014-8d2f-593238a7e35e tempest-SnapshotDependencyTests-1803193356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93b408c4-b38a-487d-a6ea-63218436fa72 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.7f49d393-7bd0-4f11-ab7e-42025b951640 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:10 devstack sudo[106020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93b408c4-b38a-487d-a6ea-63218436fa72 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.7f49d393-7bd0-4f11-ab7e-42025b951640
Sep 07 18:20:10 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:11 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ce0a6b53-efe4-4f1d-b34b-b65336da1c74 tempest-CinderUnicodeTest-1776155018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.389s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:11 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-ce0a6b53-efe4-4f1d-b34b-b65336da1c74 tempest-CinderUnicodeTest-1776155018 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:20:11 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ce0a6b53-efe4-4f1d-b34b-b65336da1c74 tempest-CinderUnicodeTest-1776155018 None] Deleted volume successfully.
Sep 07 18:20:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0e553d78-839c-4a8e-90cb-990d82b8dc14 tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ce0a6b53-efe4-4f1d-b34b-b65336da1c74 tempest-CinderUnicodeTest-1776155018 None] Lock "cinder-68db5d3a-026d-4f0f-a9ad-806600b6b2ab-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:11 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cac6a35-208e-4014-8d2f-593238a7e35e tempest-SnapshotDependencyTests-1803193356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93b408c4-b38a-487d-a6ea-63218436fa72 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.7f49d393-7bd0-4f11-ab7e-42025b951640" returned: 0 in 0.431s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:11 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-6cac6a35-208e-4014-8d2f-593238a7e35e tempest-SnapshotDependencyTests-1803193356 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.7f49d393-7bd0-4f11-ab7e-42025b951640 is being set with open permissions: ugo+rw
Sep 07 18:20:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cac6a35-208e-4014-8d2f-593238a7e35e tempest-SnapshotDependencyTests-1803193356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.7f49d393-7bd0-4f11-ab7e-42025b951640 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:11 devstack sudo[106028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.7f49d393-7bd0-4f11-ab7e-42025b951640
Sep 07 18:20:11 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:11 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cac6a35-208e-4014-8d2f-593238a7e35e tempest-SnapshotDependencyTests-1803193356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.7f49d393-7bd0-4f11-ab7e-42025b951640" returned: 0 in 0.250s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cac6a35-208e-4014-8d2f-593238a7e35e tempest-SnapshotDependencyTests-1803193356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:11 devstack sudo[106031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.info
Sep 07 18:20:11 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ef2a5d40-8c59-448c-897f-9bc7b9b93586 tempest-CinderUnicodeTest-1776155018 None] Acquiring lock "cinder-a93423b7-d970-4f6b-bc56-f5ae7f5fd20d-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:11 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cac6a35-208e-4014-8d2f-593238a7e35e tempest-SnapshotDependencyTests-1803193356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.info" returned: 0 in 0.293s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:11 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-6cac6a35-208e-4014-8d2f-593238a7e35e tempest-SnapshotDependencyTests-1803193356 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.info is being set with open permissions: ugo+rw
Sep 07 18:20:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cac6a35-208e-4014-8d2f-593238a7e35e tempest-SnapshotDependencyTests-1803193356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ef2a5d40-8c59-448c-897f-9bc7b9b93586 tempest-CinderUnicodeTest-1776155018 None] Lock "cinder-a93423b7-d970-4f6b-bc56-f5ae7f5fd20d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:11 devstack sudo[106034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.info
Sep 07 18:20:11 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ef2a5d40-8c59-448c-897f-9bc7b9b93586 tempest-CinderUnicodeTest-1776155018 None] Acquiring lock "cinder-quobyte-a93423b7-d970-4f6b-bc56-f5ae7f5fd20d" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ef2a5d40-8c59-448c-897f-9bc7b9b93586 tempest-CinderUnicodeTest-1776155018 None] Lock "cinder-quobyte-a93423b7-d970-4f6b-bc56-f5ae7f5fd20d" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:11 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e73305-0b27-4cf2-a058-52f23a9e1c12]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef2a5d40-8c59-448c-897f-9bc7b9b93586 tempest-CinderUnicodeTest-1776155018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a93423b7-d970-4f6b-bc56-f5ae7f5fd20d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:12 devstack sudo[106036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a93423b7-d970-4f6b-bc56-f5ae7f5fd20d
Sep 07 18:20:12 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:12 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-6cac6a35-208e-4014-8d2f-593238a7e35e tempest-SnapshotDependencyTests-1803193356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.info" returned: 0 in 0.284s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-6cac6a35-208e-4014-8d2f-593238a7e35e tempest-SnapshotDependencyTests-1803193356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.359s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0e553d78-839c-4a8e-90cb-990d82b8dc14 tempest-ProjectMemberTests-442300356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.987s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-0e553d78-839c-4a8e-90cb-990d82b8dc14 tempest-ProjectMemberTests-442300356 None] Creating offline snapshot c4614437-7401-4c7d-9c5d-96025a9dcec8 of volume 20b894f0-45fe-471b-bc8e-ae2fc0e54fbc {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:20:12 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-6cac6a35-208e-4014-8d2f-593238a7e35e tempest-SnapshotDependencyTests-1803193356 None] Create snapshot completed successfully
Sep 07 18:20:12 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8777c991-5784-4bcc-b923-0ce5d6835ea2]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0e553d78-839c-4a8e-90cb-990d82b8dc14 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:12 devstack sudo[106039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc
Sep 07 18:20:12 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:12 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef2a5d40-8c59-448c-897f-9bc7b9b93586 tempest-CinderUnicodeTest-1776155018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a93423b7-d970-4f6b-bc56-f5ae7f5fd20d" returned: 0 in 0.383s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef2a5d40-8c59-448c-897f-9bc7b9b93586 tempest-CinderUnicodeTest-1776155018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a93423b7-d970-4f6b-bc56-f5ae7f5fd20d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:12 devstack sudo[106044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a93423b7-d970-4f6b-bc56-f5ae7f5fd20d
Sep 07 18:20:12 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:12 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0e553d78-839c-4a8e-90cb-990d82b8dc14 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc" returned: 0 in 0.373s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0e553d78-839c-4a8e-90cb-990d82b8dc14 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc.c4614437-7401-4c7d-9c5d-96025a9dcec8 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:12 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef2a5d40-8c59-448c-897f-9bc7b9b93586 tempest-CinderUnicodeTest-1776155018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-a93423b7-d970-4f6b-bc56-f5ae7f5fd20d" returned: 0 in 0.247s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:12 devstack sudo[106050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc.c4614437-7401-4c7d-9c5d-96025a9dcec8 1G
Sep 07 18:20:12 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ef2a5d40-8c59-448c-897f-9bc7b9b93586 tempest-CinderUnicodeTest-1776155018 None] Lock "cinder-quobyte-a93423b7-d970-4f6b-bc56-f5ae7f5fd20d" released by "delete_volume" :: held 0.681s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:12 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-ef2a5d40-8c59-448c-897f-9bc7b9b93586 tempest-CinderUnicodeTest-1776155018 None] Created reservations ['daaa2415-e36c-4013-87df-c1e74fd7e20e', 'ad479752-9709-497d-8450-a2ccd146be49', '4179cdea-89a9-49c0-aca2-3b3ecfc4cd3f', 'be2d7fed-7fb9-489f-852d-793dfebc47f4'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ef2a5d40-8c59-448c-897f-9bc7b9b93586 tempest-CinderUnicodeTest-1776155018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ef2a5d40-8c59-448c-897f-9bc7b9b93586 tempest-CinderUnicodeTest-1776155018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ef2a5d40-8c59-448c-897f-9bc7b9b93586 tempest-CinderUnicodeTest-1776155018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ef2a5d40-8c59-448c-897f-9bc7b9b93586 tempest-CinderUnicodeTest-1776155018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ef2a5d40-8c59-448c-897f-9bc7b9b93586 tempest-CinderUnicodeTest-1776155018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef2a5d40-8c59-448c-897f-9bc7b9b93586 tempest-CinderUnicodeTest-1776155018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:12 devstack sudo[106052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:20:12 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:12 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef2a5d40-8c59-448c-897f-9bc7b9b93586 tempest-CinderUnicodeTest-1776155018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.271s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:12 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-ef2a5d40-8c59-448c-897f-9bc7b9b93586 tempest-CinderUnicodeTest-1776155018 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:20:12 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ef2a5d40-8c59-448c-897f-9bc7b9b93586 tempest-CinderUnicodeTest-1776155018 None] Deleted volume successfully.
Sep 07 18:20:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ef2a5d40-8c59-448c-897f-9bc7b9b93586 tempest-CinderUnicodeTest-1776155018 None] Lock "cinder-a93423b7-d970-4f6b-bc56-f5ae7f5fd20d-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:13 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0e553d78-839c-4a8e-90cb-990d82b8dc14 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc.c4614437-7401-4c7d-9c5d-96025a9dcec8 1G" returned: 0 in 0.500s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0e553d78-839c-4a8e-90cb-990d82b8dc14 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc.c4614437-7401-4c7d-9c5d-96025a9dcec8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:13 devstack sudo[106059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc.c4614437-7401-4c7d-9c5d-96025a9dcec8
Sep 07 18:20:13 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:13 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0e553d78-839c-4a8e-90cb-990d82b8dc14 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc.c4614437-7401-4c7d-9c5d-96025a9dcec8" returned: 0 in 0.367s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:13 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-0e553d78-839c-4a8e-90cb-990d82b8dc14 tempest-ProjectMemberTests-442300356 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc.c4614437-7401-4c7d-9c5d-96025a9dcec8 is being set with open permissions: ugo+rw
Sep 07 18:20:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0e553d78-839c-4a8e-90cb-990d82b8dc14 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc.c4614437-7401-4c7d-9c5d-96025a9dcec8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:13 devstack sudo[106064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc.c4614437-7401-4c7d-9c5d-96025a9dcec8
Sep 07 18:20:13 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:13 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:20:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Flow 'volume_create_manager' (5b0302e3-770b-4db0-b8f1-320a360d4e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbf5a2b-7a5f-40f8-81d0-36ee8a2e6730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbf5a2b-7a5f-40f8-81d0-36ee8a2e6730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bac839c0-6e37-4dbc-87f7-aa079e4c20e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb94d13422a046e0a2b9ca88601fb5c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7f49d393-7bd0-4f11-ab7e-42025b951640,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:13Z,use_quota=True,user_id='a08bd25b184445a18d113b39239d107c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188f5c71-fb48-498c-9246-1a7ba1a3a333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (188f5c71-fb48-498c-9246-1a7ba1a3a333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ec08d5-6365-485c-817c-402deca59fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ec08d5-6365-485c-817c-402deca59fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bac839c0-6e37-4dbc-87f7-aa079e4c20e8', 'volume_name': 'volume-bac839c0-6e37-4dbc-87f7-aa079e4c20e8', 'volume_size': 1, 'snapshot_id': '7f49d393-7bd0-4f11-ab7e-42025b951640'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e779a71-4bdf-4760-83a2-a10bff705f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e779a71-4bdf-4760-83a2-a10bff705f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:13 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8cd306d-9fff-4def-9b6d-d77a1e065dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:13 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Volume bac839c0-6e37-4dbc-87f7-aa079e4c20e8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bac839c0-6e37-4dbc-87f7-aa079e4c20e8', 'volume_size': 1, 'snapshot_id': '7f49d393-7bd0-4f11-ab7e-42025b951640'}
Sep 07 18:20:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:13 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0e553d78-839c-4a8e-90cb-990d82b8dc14 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc.c4614437-7401-4c7d-9c5d-96025a9dcec8" returned: 0 in 0.279s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0e553d78-839c-4a8e-90cb-990d82b8dc14 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:13 devstack sudo[106067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc.info
Sep 07 18:20:13 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:14 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0e553d78-839c-4a8e-90cb-990d82b8dc14 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc.info" returned: 0 in 0.277s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:14 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-0e553d78-839c-4a8e-90cb-990d82b8dc14 tempest-ProjectMemberTests-442300356 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc.info is being set with open permissions: ugo+rw
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0e553d78-839c-4a8e-90cb-990d82b8dc14 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:14 devstack sudo[106070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc.info
Sep 07 18:20:14 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:14 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0e553d78-839c-4a8e-90cb-990d82b8dc14 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc.info" returned: 0 in 0.252s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0e553d78-839c-4a8e-90cb-990d82b8dc14 tempest-ProjectMemberTests-442300356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.157s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.665s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Acquiring lock "cinder-quobyte-7f49d393-7bd0-4f11-ab7e-42025b951640-bac839c0-6e37-4dbc-87f7-aa079e4c20e8" by "_create_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Lock "cinder-quobyte-7f49d393-7bd0-4f11-ab7e-42025b951640-bac839c0-6e37-4dbc-87f7-aa079e4c20e8" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Creating volume bac839c0-6e37-4dbc-87f7-aa079e4c20e8 from snapshot 7f49d393-7bd0-4f11-ab7e-42025b951640 {{(pid=87269) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Acquiring lock "cinder-quobyte-bac839c0-6e37-4dbc-87f7-aa079e4c20e8" by "_copy_volume_from_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:14 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0e553d78-839c-4a8e-90cb-990d82b8dc14 tempest-ProjectMemberTests-442300356 None] Create snapshot completed successfully
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Lock "cinder-quobyte-bac839c0-6e37-4dbc-87f7-aa079e4c20e8" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] snapshot: 7f49d393-7bd0-4f11-ab7e-42025b951640, volume: bac839c0-6e37-4dbc-87f7-aa079e4c20e8,  {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e1999c-26d9-43d1-ac91-b331a91a5a89]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.7f49d393-7bd0-4f11-ab7e-42025b951640 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:14 devstack sudo[106073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.7f49d393-7bd0-4f11-ab7e-42025b951640
Sep 07 18:20:14 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:14 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.7f49d393-7bd0-4f11-ab7e-42025b951640" returned: 0 in 0.372s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93b408c4-b38a-487d-a6ea-63218436fa72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7dc9e7-70cc-4c9a-ae5e-d0460624a749]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:14 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:14 devstack sudo[106078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72
Sep 07 18:20:14 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:15 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72" returned: 0 in 0.383s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] will copy from snapshot at /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72 {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 07 18:20:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Creating direct copy from snapshot {{(pid=87269) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 07 18:20:15 devstack cinder-volume[87269]: DEBUG cinder.utils [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Path /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bac839c0-6e37-4dbc-87f7-aa079e4c20e8 not found in is_blk_device check {{(pid=87269) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 07 18:20:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bac839c0-6e37-4dbc-87f7-aa079e4c20e8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:15 devstack sudo[106083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bac839c0-6e37-4dbc-87f7-aa079e4c20e8
Sep 07 18:20:15 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-65d89329-9364-4da4-86fa-688ad8c262a4 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-c4614437-7401-4c7d-9c5d-96025a9dcec8-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-65d89329-9364-4da4-86fa-688ad8c262a4 tempest-ProjectMemberTests-442300356 None] Lock "cinder-c4614437-7401-4c7d-9c5d-96025a9dcec8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-65d89329-9364-4da4-86fa-688ad8c262a4 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-quobyte-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-65d89329-9364-4da4-86fa-688ad8c262a4 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-65d89329-9364-4da4-86fa-688ad8c262a4 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-quobyte-c4614437-7401-4c7d-9c5d-96025a9dcec8" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:15 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-65d89329-9364-4da4-86fa-688ad8c262a4 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-c4614437-7401-4c7d-9c5d-96025a9dcec8" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-65d89329-9364-4da4-86fa-688ad8c262a4 tempest-ProjectMemberTests-442300356 None] Deleting offline snapshot c4614437-7401-4c7d-9c5d-96025a9dcec8 of volume 20b894f0-45fe-471b-bc8e-ae2fc0e54fbc {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:20:15 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-65d89329-9364-4da4-86fa-688ad8c262a4 tempest-ProjectMemberTests-442300356 None] snapshot_file for this snap is: volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc.c4614437-7401-4c7d-9c5d-96025a9dcec8 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:20:15 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[951f80ee-5842-415d-bada-4b715991dc17]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:15 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-65d89329-9364-4da4-86fa-688ad8c262a4 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc.c4614437-7401-4c7d-9c5d-96025a9dcec8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:15 devstack sudo[106088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc.c4614437-7401-4c7d-9c5d-96025a9dcec8
Sep 07 18:20:15 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:16 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-65d89329-9364-4da4-86fa-688ad8c262a4 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc.c4614437-7401-4c7d-9c5d-96025a9dcec8" returned: 0 in 0.602s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:16 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-65d89329-9364-4da4-86fa-688ad8c262a4 tempest-ProjectMemberTests-442300356 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:20:16 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edee37e-3dd6-4327-be16-0d883d59dcf4]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:16 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-65d89329-9364-4da4-86fa-688ad8c262a4 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:16 devstack sudo[106100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc
Sep 07 18:20:16 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:17 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-65d89329-9364-4da4-86fa-688ad8c262a4 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc" returned: 0 in 0.864s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-65d89329-9364-4da4-86fa-688ad8c262a4 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc.c4614437-7401-4c7d-9c5d-96025a9dcec8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:17 devstack sudo[106108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc.c4614437-7401-4c7d-9c5d-96025a9dcec8
Sep 07 18:20:17 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:17 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-65d89329-9364-4da4-86fa-688ad8c262a4 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc.c4614437-7401-4c7d-9c5d-96025a9dcec8" returned: 0 in 0.763s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:17 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-65d89329-9364-4da4-86fa-688ad8c262a4 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc.c4614437-7401-4c7d-9c5d-96025a9dcec8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:17 devstack sudo[106113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc.c4614437-7401-4c7d-9c5d-96025a9dcec8
Sep 07 18:20:17 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:18 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:20:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Flow 'volume_create_manager' (5e3db888-8ebb-4b18-bc97-04ecf8a5523a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427eb52b-f5d2-4a0f-8fae-68c03094d60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427eb52b-f5d2-4a0f-8fae-68c03094d60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-775222235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7149464e-ad49-42dd-b63f-a7aad6b08499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122955d74f7a41f483601df502229750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:18Z,use_quota=True,user_id='91f34d73a70e42a797d7d3ec9310ed72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d14101-72a2-4699-812a-12cbcee5d446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5d14101-72a2-4699-812a-12cbcee5d446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f465103d-6b43-4be2-bd38-d3c23c528d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f465103d-6b43-4be2-bd38-d3c23c528d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7149464e-ad49-42dd-b63f-a7aad6b08499', 'volume_name': 'volume-7149464e-ad49-42dd-b63f-a7aad6b08499', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:18 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5002493c-2be5-42d6-8666-d6d2610995d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5002493c-2be5-42d6-8666-d6d2610995d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:18 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29362fe7-8fd8-4999-bb20-2b5b408f99d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:18 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Volume 7149464e-ad49-42dd-b63f-a7aad6b08499: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7149464e-ad49-42dd-b63f-a7aad6b08499', 'volume_size': 1}
Sep 07 18:20:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:18 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-65d89329-9364-4da4-86fa-688ad8c262a4 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc.c4614437-7401-4c7d-9c5d-96025a9dcec8" returned: 0 in 0.707s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-65d89329-9364-4da4-86fa-688ad8c262a4 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-c4614437-7401-4c7d-9c5d-96025a9dcec8" released by "_delete_snapshot" :: held 3.121s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-65d89329-9364-4da4-86fa-688ad8c262a4 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc" released by "delete_snapshot" :: held 3.168s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:18 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-65d89329-9364-4da4-86fa-688ad8c262a4 tempest-ProjectMemberTests-442300356 None] Created reservations ['6db7d1bf-9380-49a4-a8f9-83e59e83f0aa', '01323e3f-d7ab-447b-b801-40849e34d96d', '6c64e7e7-da45-4ec4-8b85-51d4bd4aafb2', '26cee43f-849d-43de-b81d-7897a72e3f15'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:18 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-65d89329-9364-4da4-86fa-688ad8c262a4 tempest-ProjectMemberTests-442300356 None] Delete snapshot completed successfully.
Sep 07 18:20:18 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-65d89329-9364-4da4-86fa-688ad8c262a4 tempest-ProjectMemberTests-442300356 None] Lock "cinder-c4614437-7401-4c7d-9c5d-96025a9dcec8-delete_snapshot" released by "delete_snapshot" :: held 3.548s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c78abc89-3ec1-4a04-856f-8b2817457af9 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c78abc89-3ec1-4a04-856f-8b2817457af9 tempest-ProjectMemberTests-442300356 None] Lock "cinder-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:19 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c78abc89-3ec1-4a04-856f-8b2817457af9 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-quobyte-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c78abc89-3ec1-4a04-856f-8b2817457af9 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc" acquired by "delete_volume" :: waited 0.029s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf154e0-8d91-4567-862e-0fc3caf84b1a]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c78abc89-3ec1-4a04-856f-8b2817457af9 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:20 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bac839c0-6e37-4dbc-87f7-aa079e4c20e8" returned: 0 in 5.046s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG cinder.image.image_utils [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Image conversion details: src /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72, size 1024.00 MB, duration 5.05 sec, destination /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bac839c0-6e37-4dbc-87f7-aa079e4c20e8 {{(pid=87269) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 07 18:20:20 devstack cinder-volume[87269]: INFO cinder.image.image_utils [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Converted 1024.00 MB image at 202.89 MB/s
Sep 07 18:20:20 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bac839c0-6e37-4dbc-87f7-aa079e4c20e8 is being set with open permissions: ugo+rw
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bac839c0-6e37-4dbc-87f7-aa079e4c20e8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:20 devstack sudo[106117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bac839c0-6e37-4dbc-87f7-aa079e4c20e8
Sep 07 18:20:20 devstack sudo[106116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc
Sep 07 18:20:20 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:20 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:20 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bac839c0-6e37-4dbc-87f7-aa079e4c20e8" returned: 0 in 0.239s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Lock "cinder-quobyte-bac839c0-6e37-4dbc-87f7-aa079e4c20e8" released by "_copy_volume_from_snapshot" :: held 6.138s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:20 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c78abc89-3ec1-4a04-856f-8b2817457af9 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc" returned: 0 in 0.401s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c78abc89-3ec1-4a04-856f-8b2817457af9 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:20 devstack sudo[106124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc
Sep 07 18:20:20 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Lock "cinder-quobyte-7f49d393-7bd0-4f11-ab7e-42025b951640-bac839c0-6e37-4dbc-87f7-aa079e4c20e8" released by "_create_volume_from_snapshot" :: held 6.232s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.257s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.063s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-775222235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7149464e-ad49-42dd-b63f-a7aad6b08499,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122955d74f7a41f483601df502229750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:18Z,use_quota=True,user_id='91f34d73a70e42a797d7d3ec9310ed72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Creating volume 7149464e-ad49-42dd-b63f-a7aad6b08499 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:20:20 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:20 devstack sudo[106126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499 1073741824
Sep 07 18:20:20 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8cd306d-9fff-4def-9b6d-d77a1e065dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bac839c0-6e37-4dbc-87f7-aa079e4c20e8', 'volume_size': 1, 'snapshot_id': '7f49d393-7bd0-4f11-ab7e-42025b951640'}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ebcb491-2228-4b93-a2ac-dfc0f2742a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:20 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Volume volume-bac839c0-6e37-4dbc-87f7-aa079e4c20e8 (bac839c0-6e37-4dbc-87f7-aa079e4c20e8): created successfully
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ebcb491-2228-4b93-a2ac-dfc0f2742a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Flow 'volume_create_manager' (5b0302e3-770b-4db0-b8f1-320a360d4e48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:20 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-38d83fb4-c8db-4082-92fa-819227eead69 tempest-SnapshotDependencyTests-1803193356 None] Created volume successfully.
Sep 07 18:20:20 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c78abc89-3ec1-4a04-856f-8b2817457af9 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc" returned: 0 in 0.245s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c78abc89-3ec1-4a04-856f-8b2817457af9 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc" released by "delete_volume" :: held 0.764s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-c78abc89-3ec1-4a04-856f-8b2817457af9 tempest-ProjectMemberTests-442300356 None] Created reservations ['4e74b3fe-c539-4f1e-ad53-939135a3a928', '37571836-c928-46ea-bb38-8729204815af', 'b32c2778-3092-451a-a56b-435519434c13', 'be448035-b330-4bd4-a9e8-c1a30c5316d6'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c78abc89-3ec1-4a04-856f-8b2817457af9 tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c78abc89-3ec1-4a04-856f-8b2817457af9 tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c78abc89-3ec1-4a04-856f-8b2817457af9 tempest-ProjectMemberTests-442300356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c78abc89-3ec1-4a04-856f-8b2817457af9 tempest-ProjectMemberTests-442300356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c78abc89-3ec1-4a04-856f-8b2817457af9 tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:20 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c78abc89-3ec1-4a04-856f-8b2817457af9 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:20 devstack sudo[106133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:20:20 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:21 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499 1073741824" returned: 0 in 0.437s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:21 devstack sudo[106135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499
Sep 07 18:20:21 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:21 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c78abc89-3ec1-4a04-856f-8b2817457af9 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.255s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-c78abc89-3ec1-4a04-856f-8b2817457af9 tempest-ProjectMemberTests-442300356 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:20:21 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-c78abc89-3ec1-4a04-856f-8b2817457af9 tempest-ProjectMemberTests-442300356 None] Deleted volume successfully.
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c78abc89-3ec1-4a04-856f-8b2817457af9 tempest-ProjectMemberTests-442300356 None] Lock "cinder-20b894f0-45fe-471b-bc8e-ae2fc0e54fbc-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:21 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499" returned: 0 in 0.275s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29362fe7-8fd8-4999-bb20-2b5b408f99d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7149464e-ad49-42dd-b63f-a7aad6b08499', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8fda73-8715-4ac4-8a75-a5d0156feb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:21 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Volume volume-7149464e-ad49-42dd-b63f-a7aad6b08499 (7149464e-ad49-42dd-b63f-a7aad6b08499): created successfully
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8fda73-8715-4ac4-8a75-a5d0156feb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Flow 'volume_create_manager' (5e3db888-8ebb-4b18-bc97-04ecf8a5523a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:21 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-0440fcbb-7f8f-4056-bb54-c27d230b6007 tempest-ProjectReaderTests-554049164 None] Created volume successfully.
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-45f236a8-cbc0-4905-92a3-04201f9230dd tempest-SnapshotDependencyTests-1803193356 None] Acquiring lock "cinder-7f49d393-7bd0-4f11-ab7e-42025b951640-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-45f236a8-cbc0-4905-92a3-04201f9230dd tempest-SnapshotDependencyTests-1803193356 None] Lock "cinder-7f49d393-7bd0-4f11-ab7e-42025b951640-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-45f236a8-cbc0-4905-92a3-04201f9230dd tempest-SnapshotDependencyTests-1803193356 None] Acquiring lock "cinder-quobyte-93b408c4-b38a-487d-a6ea-63218436fa72" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-45f236a8-cbc0-4905-92a3-04201f9230dd tempest-SnapshotDependencyTests-1803193356 None] Lock "cinder-quobyte-93b408c4-b38a-487d-a6ea-63218436fa72" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-45f236a8-cbc0-4905-92a3-04201f9230dd tempest-SnapshotDependencyTests-1803193356 None] Acquiring lock "cinder-quobyte-7f49d393-7bd0-4f11-ab7e-42025b951640" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-45f236a8-cbc0-4905-92a3-04201f9230dd tempest-SnapshotDependencyTests-1803193356 None] Lock "cinder-quobyte-7f49d393-7bd0-4f11-ab7e-42025b951640" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-45f236a8-cbc0-4905-92a3-04201f9230dd tempest-SnapshotDependencyTests-1803193356 None] Deleting offline snapshot 7f49d393-7bd0-4f11-ab7e-42025b951640 of volume 93b408c4-b38a-487d-a6ea-63218436fa72 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-45f236a8-cbc0-4905-92a3-04201f9230dd tempest-SnapshotDependencyTests-1803193356 None] snapshot_file for this snap is: volume-93b408c4-b38a-487d-a6ea-63218436fa72.7f49d393-7bd0-4f11-ab7e-42025b951640 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d95a127-5ff2-4da2-804f-f975b3bf5602]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45f236a8-cbc0-4905-92a3-04201f9230dd tempest-SnapshotDependencyTests-1803193356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.7f49d393-7bd0-4f11-ab7e-42025b951640 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:20:21 devstack sudo[106139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.7f49d393-7bd0-4f11-ab7e-42025b951640
Sep 07 18:20:21 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Flow 'volume_create_manager' (54ad81a4-56aa-47a4-b1b8-e6c201444faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b1d9efa-1d42-4d62-9315-cdba6e05d4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b1d9efa-1d42-4d62-9315-cdba6e05d4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1368487950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faafd390-2a5d-4b96-bdd2-a89ea89db71d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e449daccfbab4cd8ba38df886cea84bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:22Z,use_quota=True,user_id='d0204c187bcf4a5ba9582bac88f452df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e79728d1-2e83-4525-bffa-0df967fdb742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e79728d1-2e83-4525-bffa-0df967fdb742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acc48108-8ed9-4484-be7f-6918ffdfc86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acc48108-8ed9-4484-be7f-6918ffdfc86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faafd390-2a5d-4b96-bdd2-a89ea89db71d', 'volume_name': 'volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447f21b0-e427-40d9-bd7b-189a5596f505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (447f21b0-e427-40d9-bd7b-189a5596f505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3447d96-818a-4271-b480-c23eb5fe3749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:21 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Volume faafd390-2a5d-4b96-bdd2-a89ea89db71d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d', 'volume_size': 1}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1368487950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faafd390-2a5d-4b96-bdd2-a89ea89db71d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e449daccfbab4cd8ba38df886cea84bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:22Z,use_quota=True,user_id='d0204c187bcf4a5ba9582bac88f452df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Creating volume faafd390-2a5d-4b96-bdd2-a89ea89db71d {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:20:21 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:21 devstack sudo[106141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d 1073741824
Sep 07 18:20:21 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:21 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45f236a8-cbc0-4905-92a3-04201f9230dd tempest-SnapshotDependencyTests-1803193356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.7f49d393-7bd0-4f11-ab7e-42025b951640" returned: 0 in 0.362s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-45f236a8-cbc0-4905-92a3-04201f9230dd tempest-SnapshotDependencyTests-1803193356 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93b408c4-b38a-487d-a6ea-63218436fa72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e12cfa9-ee37-4ee9-9241-de507c706e2c]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:21 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45f236a8-cbc0-4905-92a3-04201f9230dd tempest-SnapshotDependencyTests-1803193356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:22 devstack sudo[106146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72
Sep 07 18:20:22 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:22 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d 1073741824" returned: 0 in 0.415s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:22 devstack sudo[106151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d
Sep 07 18:20:22 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:22 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d" returned: 0 in 0.267s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:20:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:22 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3447d96-818a-4271-b480-c23eb5fe3749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a83e55d0-d503-437d-9f73-96c2e335f842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45f236a8-cbc0-4905-92a3-04201f9230dd tempest-SnapshotDependencyTests-1803193356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72" returned: 0 in 0.558s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45f236a8-cbc0-4905-92a3-04201f9230dd tempest-SnapshotDependencyTests-1803193356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.7f49d393-7bd0-4f11-ab7e-42025b951640 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:22 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Volume volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d (faafd390-2a5d-4b96-bdd2-a89ea89db71d): created successfully
Sep 07 18:20:22 devstack sudo[106157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.7f49d393-7bd0-4f11-ab7e-42025b951640
Sep 07 18:20:22 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a83e55d0-d503-437d-9f73-96c2e335f842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:22 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Flow 'volume_create_manager' (54ad81a4-56aa-47a4-b1b8-e6c201444faa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:22 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e17ac98c-b51c-4ce6-8fde-3de1467e8d07 tempest-ProjectMemberTests-442300356 None] Created volume successfully.
Sep 07 18:20:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-58b591ae-022a-4bd4-a945-4c86d11f2810 tempest-ProjectReaderTests-554049164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-58b591ae-022a-4bd4-a945-4c86d11f2810 tempest-ProjectReaderTests-554049164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:22 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-58b591ae-022a-4bd4-a945-4c86d11f2810 tempest-ProjectReaderTests-554049164 None] Creating offline snapshot c0afafac-3ef4-4fe3-97ec-e68a3024d0c2 of volume 7149464e-ad49-42dd-b63f-a7aad6b08499 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:20:22 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d2c01f-8c54-44b9-b1a5-16393e59f0db]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58b591ae-022a-4bd4-a945-4c86d11f2810 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ef65abac-ef5e-46eb-a5f7-8c9d6e65a4d6 tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:22 devstack sudo[106161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499
Sep 07 18:20:22 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:22 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45f236a8-cbc0-4905-92a3-04201f9230dd tempest-SnapshotDependencyTests-1803193356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.7f49d393-7bd0-4f11-ab7e-42025b951640" returned: 0 in 0.405s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:22 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45f236a8-cbc0-4905-92a3-04201f9230dd tempest-SnapshotDependencyTests-1803193356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.7f49d393-7bd0-4f11-ab7e-42025b951640 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:22 devstack sudo[106164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.7f49d393-7bd0-4f11-ab7e-42025b951640
Sep 07 18:20:22 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:23 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:23 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58b591ae-022a-4bd4-a945-4c86d11f2810 tempest-ProjectReaderTests-554049164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499" returned: 0 in 0.402s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58b591ae-022a-4bd4-a945-4c86d11f2810 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499.c0afafac-3ef4-4fe3-97ec-e68a3024d0c2 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-45f236a8-cbc0-4905-92a3-04201f9230dd tempest-SnapshotDependencyTests-1803193356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72.7f49d393-7bd0-4f11-ab7e-42025b951640" returned: 0 in 0.258s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:23 devstack sudo[106171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499.c0afafac-3ef4-4fe3-97ec-e68a3024d0c2 1G
Sep 07 18:20:23 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-45f236a8-cbc0-4905-92a3-04201f9230dd tempest-SnapshotDependencyTests-1803193356 None] Lock "cinder-quobyte-7f49d393-7bd0-4f11-ab7e-42025b951640" released by "_delete_snapshot" :: held 1.675s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-45f236a8-cbc0-4905-92a3-04201f9230dd tempest-SnapshotDependencyTests-1803193356 None] Lock "cinder-quobyte-93b408c4-b38a-487d-a6ea-63218436fa72" released by "delete_snapshot" :: held 1.701s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:23 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-45f236a8-cbc0-4905-92a3-04201f9230dd tempest-SnapshotDependencyTests-1803193356 None] Created reservations ['c037e568-ee65-4e72-8e70-f9f39723e758', '3a335ee7-0a75-4480-b1ac-fb85c855c2b0', 'dd911f02-da1c-4b83-8732-8a692aa11116', '2e2fb951-2fa5-455d-9863-7435e95607ca'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:23 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-45f236a8-cbc0-4905-92a3-04201f9230dd tempest-SnapshotDependencyTests-1803193356 None] Delete snapshot completed successfully.
Sep 07 18:20:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-45f236a8-cbc0-4905-92a3-04201f9230dd tempest-SnapshotDependencyTests-1803193356 None] Lock "cinder-7f49d393-7bd0-4f11-ab7e-42025b951640-delete_snapshot" released by "delete_snapshot" :: held 1.847s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:23 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58b591ae-022a-4bd4-a945-4c86d11f2810 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499.c0afafac-3ef4-4fe3-97ec-e68a3024d0c2 1G" returned: 0 in 0.374s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58b591ae-022a-4bd4-a945-4c86d11f2810 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7149464e-ad49-42dd-b63f-a7aad6b08499 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499.c0afafac-3ef4-4fe3-97ec-e68a3024d0c2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:23 devstack sudo[106176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7149464e-ad49-42dd-b63f-a7aad6b08499 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499.c0afafac-3ef4-4fe3-97ec-e68a3024d0c2
Sep 07 18:20:23 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-58bb4300-91cd-4620-97ae-00ce8f2ee201 tempest-SnapshotDependencyTests-1803193356 None] Acquiring lock "cinder-93b408c4-b38a-487d-a6ea-63218436fa72-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-58bb4300-91cd-4620-97ae-00ce8f2ee201 tempest-SnapshotDependencyTests-1803193356 None] Lock "cinder-93b408c4-b38a-487d-a6ea-63218436fa72-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-58bb4300-91cd-4620-97ae-00ce8f2ee201 tempest-SnapshotDependencyTests-1803193356 None] Acquiring lock "cinder-quobyte-93b408c4-b38a-487d-a6ea-63218436fa72" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:23 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-58bb4300-91cd-4620-97ae-00ce8f2ee201 tempest-SnapshotDependencyTests-1803193356 None] Lock "cinder-quobyte-93b408c4-b38a-487d-a6ea-63218436fa72" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:23 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[27507596-c782-4dbc-b659-65384a1b5b5c]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58bb4300-91cd-4620-97ae-00ce8f2ee201 tempest-SnapshotDependencyTests-1803193356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:23 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58b591ae-022a-4bd4-a945-4c86d11f2810 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7149464e-ad49-42dd-b63f-a7aad6b08499 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499.c0afafac-3ef4-4fe3-97ec-e68a3024d0c2" returned: 0 in 0.329s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:23 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-58b591ae-022a-4bd4-a945-4c86d11f2810 tempest-ProjectReaderTests-554049164 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499.c0afafac-3ef4-4fe3-97ec-e68a3024d0c2 is being set with open permissions: ugo+rw
Sep 07 18:20:23 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58b591ae-022a-4bd4-a945-4c86d11f2810 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499.c0afafac-3ef4-4fe3-97ec-e68a3024d0c2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:23 devstack sudo[106180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72
Sep 07 18:20:23 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:23 devstack sudo[106182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499.c0afafac-3ef4-4fe3-97ec-e68a3024d0c2
Sep 07 18:20:23 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:24 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58b591ae-022a-4bd4-a945-4c86d11f2810 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499.c0afafac-3ef4-4fe3-97ec-e68a3024d0c2" returned: 0 in 0.238s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58b591ae-022a-4bd4-a945-4c86d11f2810 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:24 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58bb4300-91cd-4620-97ae-00ce8f2ee201 tempest-SnapshotDependencyTests-1803193356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72" returned: 0 in 0.375s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58bb4300-91cd-4620-97ae-00ce8f2ee201 tempest-SnapshotDependencyTests-1803193356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:24 devstack sudo[106189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499.info
Sep 07 18:20:24 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:24 devstack sudo[106190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72
Sep 07 18:20:24 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:24 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58b591ae-022a-4bd4-a945-4c86d11f2810 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499.info" returned: 0 in 0.249s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:24 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-58b591ae-022a-4bd4-a945-4c86d11f2810 tempest-ProjectReaderTests-554049164 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499.info is being set with open permissions: ugo+rw
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58b591ae-022a-4bd4-a945-4c86d11f2810 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:24 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58bb4300-91cd-4620-97ae-00ce8f2ee201 tempest-SnapshotDependencyTests-1803193356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-93b408c4-b38a-487d-a6ea-63218436fa72" returned: 0 in 0.245s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:24 devstack sudo[106201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499.info
Sep 07 18:20:24 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-58bb4300-91cd-4620-97ae-00ce8f2ee201 tempest-SnapshotDependencyTests-1803193356 None] Lock "cinder-quobyte-93b408c4-b38a-487d-a6ea-63218436fa72" released by "delete_volume" :: held 0.681s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-58bb4300-91cd-4620-97ae-00ce8f2ee201 tempest-SnapshotDependencyTests-1803193356 None] Created reservations ['8ca6ee1b-a87b-49d4-b734-02c19f772fa0', '8c0b24ec-ffd6-400e-9be4-1a9a77586522', '19bbf20b-2d5a-42c8-999b-23c897ab62e6', 'b6bb1a53-4524-42b8-897f-da331327f20b'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-58bb4300-91cd-4620-97ae-00ce8f2ee201 tempest-SnapshotDependencyTests-1803193356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-58bb4300-91cd-4620-97ae-00ce8f2ee201 tempest-SnapshotDependencyTests-1803193356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-58bb4300-91cd-4620-97ae-00ce8f2ee201 tempest-SnapshotDependencyTests-1803193356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-58bb4300-91cd-4620-97ae-00ce8f2ee201 tempest-SnapshotDependencyTests-1803193356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-58bb4300-91cd-4620-97ae-00ce8f2ee201 tempest-SnapshotDependencyTests-1803193356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58bb4300-91cd-4620-97ae-00ce8f2ee201 tempest-SnapshotDependencyTests-1803193356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:24 devstack sudo[106203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:20:24 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:24 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58b591ae-022a-4bd4-a945-4c86d11f2810 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499.info" returned: 0 in 0.253s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-58b591ae-022a-4bd4-a945-4c86d11f2810 tempest-ProjectReaderTests-554049164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.941s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ef65abac-ef5e-46eb-a5f7-8c9d6e65a4d6 tempest-ProjectMemberTests-442300356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.813s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ef65abac-ef5e-46eb-a5f7-8c9d6e65a4d6 tempest-ProjectMemberTests-442300356 None] Creating offline snapshot e6951f36-0665-479f-afa0-dac15382ce2f of volume faafd390-2a5d-4b96-bdd2-a89ea89db71d {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:20:24 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-58b591ae-022a-4bd4-a945-4c86d11f2810 tempest-ProjectReaderTests-554049164 None] Create snapshot completed successfully
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[089b7d6f-5b41-41d1-a3d8-034595aa611c]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef65abac-ef5e-46eb-a5f7-8c9d6e65a4d6 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:24 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-58bb4300-91cd-4620-97ae-00ce8f2ee201 tempest-SnapshotDependencyTests-1803193356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.264s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-58bb4300-91cd-4620-97ae-00ce8f2ee201 tempest-SnapshotDependencyTests-1803193356 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:20:24 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-58bb4300-91cd-4620-97ae-00ce8f2ee201 tempest-SnapshotDependencyTests-1803193356 None] Deleted volume successfully.
Sep 07 18:20:24 devstack sudo[106206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d
Sep 07 18:20:24 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-58bb4300-91cd-4620-97ae-00ce8f2ee201 tempest-SnapshotDependencyTests-1803193356 None] Lock "cinder-93b408c4-b38a-487d-a6ea-63218436fa72-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1015a434-08ec-42e0-9d9a-325b650fb37d tempest-SnapshotDependencyTests-1803193356 None] Acquiring lock "cinder-bac839c0-6e37-4dbc-87f7-aa079e4c20e8-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1015a434-08ec-42e0-9d9a-325b650fb37d tempest-SnapshotDependencyTests-1803193356 None] Lock "cinder-bac839c0-6e37-4dbc-87f7-aa079e4c20e8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1015a434-08ec-42e0-9d9a-325b650fb37d tempest-SnapshotDependencyTests-1803193356 None] Acquiring lock "cinder-quobyte-bac839c0-6e37-4dbc-87f7-aa079e4c20e8" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1015a434-08ec-42e0-9d9a-325b650fb37d tempest-SnapshotDependencyTests-1803193356 None] Lock "cinder-quobyte-bac839c0-6e37-4dbc-87f7-aa079e4c20e8" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a1799e-d2bb-468c-848b-7d0b9646c896]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1015a434-08ec-42e0-9d9a-325b650fb37d tempest-SnapshotDependencyTests-1803193356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bac839c0-6e37-4dbc-87f7-aa079e4c20e8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:24 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ec35db61-8efc-49a6-bdb0-5e1e5be91a1c tempest-ProjectReaderTests-554049164 None] Acquiring lock "cinder-c0afafac-3ef4-4fe3-97ec-e68a3024d0c2-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ec35db61-8efc-49a6-bdb0-5e1e5be91a1c tempest-ProjectReaderTests-554049164 None] Lock "cinder-c0afafac-3ef4-4fe3-97ec-e68a3024d0c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ec35db61-8efc-49a6-bdb0-5e1e5be91a1c tempest-ProjectReaderTests-554049164 None] Acquiring lock "cinder-quobyte-7149464e-ad49-42dd-b63f-a7aad6b08499" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ec35db61-8efc-49a6-bdb0-5e1e5be91a1c tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-7149464e-ad49-42dd-b63f-a7aad6b08499" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ec35db61-8efc-49a6-bdb0-5e1e5be91a1c tempest-ProjectReaderTests-554049164 None] Acquiring lock "cinder-quobyte-c0afafac-3ef4-4fe3-97ec-e68a3024d0c2" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ec35db61-8efc-49a6-bdb0-5e1e5be91a1c tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-c0afafac-3ef4-4fe3-97ec-e68a3024d0c2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ec35db61-8efc-49a6-bdb0-5e1e5be91a1c tempest-ProjectReaderTests-554049164 None] Deleting offline snapshot c0afafac-3ef4-4fe3-97ec-e68a3024d0c2 of volume 7149464e-ad49-42dd-b63f-a7aad6b08499 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ec35db61-8efc-49a6-bdb0-5e1e5be91a1c tempest-ProjectReaderTests-554049164 None] snapshot_file for this snap is: volume-7149464e-ad49-42dd-b63f-a7aad6b08499.c0afafac-3ef4-4fe3-97ec-e68a3024d0c2 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7173e7-520c-4ed2-a172-3f0610e32aa9]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ec35db61-8efc-49a6-bdb0-5e1e5be91a1c tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499.c0afafac-3ef4-4fe3-97ec-e68a3024d0c2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:25 devstack sudo[106209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bac839c0-6e37-4dbc-87f7-aa079e4c20e8
Sep 07 18:20:25 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:25 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef65abac-ef5e-46eb-a5f7-8c9d6e65a4d6 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d" returned: 0 in 0.445s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef65abac-ef5e-46eb-a5f7-8c9d6e65a4d6 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d.e6951f36-0665-479f-afa0-dac15382ce2f 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:25 devstack sudo[106216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d.e6951f36-0665-479f-afa0-dac15382ce2f 1G
Sep 07 18:20:25 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:25 devstack sudo[106215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499.c0afafac-3ef4-4fe3-97ec-e68a3024d0c2
Sep 07 18:20:25 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:25 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1015a434-08ec-42e0-9d9a-325b650fb37d tempest-SnapshotDependencyTests-1803193356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bac839c0-6e37-4dbc-87f7-aa079e4c20e8" returned: 0 in 0.407s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1015a434-08ec-42e0-9d9a-325b650fb37d tempest-SnapshotDependencyTests-1803193356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bac839c0-6e37-4dbc-87f7-aa079e4c20e8 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:25 devstack sudo[106226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bac839c0-6e37-4dbc-87f7-aa079e4c20e8
Sep 07 18:20:25 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:25 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ec35db61-8efc-49a6-bdb0-5e1e5be91a1c tempest-ProjectReaderTests-554049164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499.c0afafac-3ef4-4fe3-97ec-e68a3024d0c2" returned: 0 in 0.385s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ec35db61-8efc-49a6-bdb0-5e1e5be91a1c tempest-ProjectReaderTests-554049164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7149464e-ad49-42dd-b63f-a7aad6b08499(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3088b8-5f93-4e43-b16a-7547019aef29]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ec35db61-8efc-49a6-bdb0-5e1e5be91a1c tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:25 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef65abac-ef5e-46eb-a5f7-8c9d6e65a4d6 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d.e6951f36-0665-479f-afa0-dac15382ce2f 1G" returned: 0 in 0.415s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef65abac-ef5e-46eb-a5f7-8c9d6e65a4d6 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d.e6951f36-0665-479f-afa0-dac15382ce2f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:25 devstack sudo[106232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d.e6951f36-0665-479f-afa0-dac15382ce2f
Sep 07 18:20:25 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:25 devstack sudo[106231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499
Sep 07 18:20:25 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:25 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1015a434-08ec-42e0-9d9a-325b650fb37d tempest-SnapshotDependencyTests-1803193356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bac839c0-6e37-4dbc-87f7-aa079e4c20e8" returned: 0 in 0.261s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1015a434-08ec-42e0-9d9a-325b650fb37d tempest-SnapshotDependencyTests-1803193356 None] Lock "cinder-quobyte-bac839c0-6e37-4dbc-87f7-aa079e4c20e8" released by "delete_volume" :: held 0.721s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-1015a434-08ec-42e0-9d9a-325b650fb37d tempest-SnapshotDependencyTests-1803193356 None] Created reservations ['27365674-dd7e-44ee-9755-5289bb474548', '47421a93-30ca-4d10-b518-5ca3ffa0c188', '57de0d00-7987-410d-a20e-9228dadab678', '581444ba-b719-4074-9c4e-251149afdae1'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1015a434-08ec-42e0-9d9a-325b650fb37d tempest-SnapshotDependencyTests-1803193356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1015a434-08ec-42e0-9d9a-325b650fb37d tempest-SnapshotDependencyTests-1803193356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1015a434-08ec-42e0-9d9a-325b650fb37d tempest-SnapshotDependencyTests-1803193356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1015a434-08ec-42e0-9d9a-325b650fb37d tempest-SnapshotDependencyTests-1803193356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1015a434-08ec-42e0-9d9a-325b650fb37d tempest-SnapshotDependencyTests-1803193356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1015a434-08ec-42e0-9d9a-325b650fb37d tempest-SnapshotDependencyTests-1803193356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:25 devstack sudo[106238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:20:25 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:25 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef65abac-ef5e-46eb-a5f7-8c9d6e65a4d6 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d.e6951f36-0665-479f-afa0-dac15382ce2f" returned: 0 in 0.358s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:25 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-ef65abac-ef5e-46eb-a5f7-8c9d6e65a4d6 tempest-ProjectMemberTests-442300356 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d.e6951f36-0665-479f-afa0-dac15382ce2f is being set with open permissions: ugo+rw
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef65abac-ef5e-46eb-a5f7-8c9d6e65a4d6 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d.e6951f36-0665-479f-afa0-dac15382ce2f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:25 devstack sudo[106244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d.e6951f36-0665-479f-afa0-dac15382ce2f
Sep 07 18:20:25 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:25 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ec35db61-8efc-49a6-bdb0-5e1e5be91a1c tempest-ProjectReaderTests-554049164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499" returned: 0 in 0.431s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:25 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ec35db61-8efc-49a6-bdb0-5e1e5be91a1c tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499.c0afafac-3ef4-4fe3-97ec-e68a3024d0c2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:25 devstack sudo[106246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499.c0afafac-3ef4-4fe3-97ec-e68a3024d0c2
Sep 07 18:20:25 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:26 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1015a434-08ec-42e0-9d9a-325b650fb37d tempest-SnapshotDependencyTests-1803193356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.283s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:26 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-1015a434-08ec-42e0-9d9a-325b650fb37d tempest-SnapshotDependencyTests-1803193356 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:20:26 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-1015a434-08ec-42e0-9d9a-325b650fb37d tempest-SnapshotDependencyTests-1803193356 None] Deleted volume successfully.
Sep 07 18:20:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1015a434-08ec-42e0-9d9a-325b650fb37d tempest-SnapshotDependencyTests-1803193356 None] Lock "cinder-bac839c0-6e37-4dbc-87f7-aa079e4c20e8-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:26 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef65abac-ef5e-46eb-a5f7-8c9d6e65a4d6 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d.e6951f36-0665-479f-afa0-dac15382ce2f" returned: 0 in 0.289s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef65abac-ef5e-46eb-a5f7-8c9d6e65a4d6 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:26 devstack sudo[106252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d.info
Sep 07 18:20:26 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:26 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ec35db61-8efc-49a6-bdb0-5e1e5be91a1c tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499.c0afafac-3ef4-4fe3-97ec-e68a3024d0c2" returned: 0 in 0.404s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ec35db61-8efc-49a6-bdb0-5e1e5be91a1c tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499.c0afafac-3ef4-4fe3-97ec-e68a3024d0c2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:26 devstack sudo[106256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499.c0afafac-3ef4-4fe3-97ec-e68a3024d0c2
Sep 07 18:20:26 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:26 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef65abac-ef5e-46eb-a5f7-8c9d6e65a4d6 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d.info" returned: 0 in 0.264s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:26 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-ef65abac-ef5e-46eb-a5f7-8c9d6e65a4d6 tempest-ProjectMemberTests-442300356 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d.info is being set with open permissions: ugo+rw
Sep 07 18:20:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef65abac-ef5e-46eb-a5f7-8c9d6e65a4d6 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:26 devstack sudo[106260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d.info
Sep 07 18:20:26 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:26 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ec35db61-8efc-49a6-bdb0-5e1e5be91a1c tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499.c0afafac-3ef4-4fe3-97ec-e68a3024d0c2" returned: 0 in 0.265s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ec35db61-8efc-49a6-bdb0-5e1e5be91a1c tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-c0afafac-3ef4-4fe3-97ec-e68a3024d0c2" released by "_delete_snapshot" :: held 1.582s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ec35db61-8efc-49a6-bdb0-5e1e5be91a1c tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-7149464e-ad49-42dd-b63f-a7aad6b08499" released by "delete_snapshot" :: held 1.605s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:26 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-ec35db61-8efc-49a6-bdb0-5e1e5be91a1c tempest-ProjectReaderTests-554049164 None] Created reservations ['a846b645-cbdd-44fd-af57-35ff19bca98e', '494e6c23-aae4-407d-8e4f-03beacc5adb7', '8069bf75-7e62-4076-a39d-7b9dfa5d7e33', '1bdbfca3-c029-40f7-a917-d583a82d15cd'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:26 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ef65abac-ef5e-46eb-a5f7-8c9d6e65a4d6 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d.info" returned: 0 in 0.255s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:26 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ef65abac-ef5e-46eb-a5f7-8c9d6e65a4d6 tempest-ProjectMemberTests-442300356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.117s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:26 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ef65abac-ef5e-46eb-a5f7-8c9d6e65a4d6 tempest-ProjectMemberTests-442300356 None] Create snapshot completed successfully
Sep 07 18:20:26 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ec35db61-8efc-49a6-bdb0-5e1e5be91a1c tempest-ProjectReaderTests-554049164 None] Delete snapshot completed successfully.
Sep 07 18:20:26 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ec35db61-8efc-49a6-bdb0-5e1e5be91a1c tempest-ProjectReaderTests-554049164 None] Lock "cinder-c0afafac-3ef4-4fe3-97ec-e68a3024d0c2-delete_snapshot" released by "delete_snapshot" :: held 1.790s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9be3d539-b3c7-4bc7-9003-2776922d7bd0 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-e6951f36-0665-479f-afa0-dac15382ce2f-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9be3d539-b3c7-4bc7-9003-2776922d7bd0 tempest-ProjectMemberTests-442300356 None] Lock "cinder-e6951f36-0665-479f-afa0-dac15382ce2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9be3d539-b3c7-4bc7-9003-2776922d7bd0 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-quobyte-faafd390-2a5d-4b96-bdd2-a89ea89db71d" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9be3d539-b3c7-4bc7-9003-2776922d7bd0 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-faafd390-2a5d-4b96-bdd2-a89ea89db71d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9be3d539-b3c7-4bc7-9003-2776922d7bd0 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-quobyte-e6951f36-0665-479f-afa0-dac15382ce2f" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9be3d539-b3c7-4bc7-9003-2776922d7bd0 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-e6951f36-0665-479f-afa0-dac15382ce2f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9be3d539-b3c7-4bc7-9003-2776922d7bd0 tempest-ProjectMemberTests-442300356 None] Deleting offline snapshot e6951f36-0665-479f-afa0-dac15382ce2f of volume faafd390-2a5d-4b96-bdd2-a89ea89db71d {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:20:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9be3d539-b3c7-4bc7-9003-2776922d7bd0 tempest-ProjectMemberTests-442300356 None] snapshot_file for this snap is: volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d.e6951f36-0665-479f-afa0-dac15382ce2f {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:20:27 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73846ae-3aed-43ef-a852-b910e0d451b9]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9be3d539-b3c7-4bc7-9003-2776922d7bd0 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d.e6951f36-0665-479f-afa0-dac15382ce2f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d35737dc-dafb-435b-bd12-d4c1d0541f56 tempest-ProjectReaderTests-554049164 None] Acquiring lock "cinder-7149464e-ad49-42dd-b63f-a7aad6b08499-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d35737dc-dafb-435b-bd12-d4c1d0541f56 tempest-ProjectReaderTests-554049164 None] Lock "cinder-7149464e-ad49-42dd-b63f-a7aad6b08499-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d35737dc-dafb-435b-bd12-d4c1d0541f56 tempest-ProjectReaderTests-554049164 None] Acquiring lock "cinder-quobyte-7149464e-ad49-42dd-b63f-a7aad6b08499" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:27 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d35737dc-dafb-435b-bd12-d4c1d0541f56 tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-7149464e-ad49-42dd-b63f-a7aad6b08499" acquired by "delete_volume" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:27 devstack sudo[106265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d.e6951f36-0665-479f-afa0-dac15382ce2f
Sep 07 18:20:27 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:27 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2e7896-f522-4dd6-b0ca-88e5b685cd08]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d35737dc-dafb-435b-bd12-d4c1d0541f56 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:27 devstack sudo[106267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499
Sep 07 18:20:27 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:27 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9be3d539-b3c7-4bc7-9003-2776922d7bd0 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d.e6951f36-0665-479f-afa0-dac15382ce2f" returned: 0 in 0.387s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:27 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9be3d539-b3c7-4bc7-9003-2776922d7bd0 tempest-ProjectMemberTests-442300356 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:20:27 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[41820f53-0b67-4940-a5ad-8a30dc9929b1]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9be3d539-b3c7-4bc7-9003-2776922d7bd0 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:27 devstack sudo[106273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d
Sep 07 18:20:27 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:27 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d35737dc-dafb-435b-bd12-d4c1d0541f56 tempest-ProjectReaderTests-554049164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499" returned: 0 in 0.442s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:27 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d35737dc-dafb-435b-bd12-d4c1d0541f56 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:27 devstack sudo[106278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499
Sep 07 18:20:27 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:28 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9be3d539-b3c7-4bc7-9003-2776922d7bd0 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d" returned: 0 in 0.403s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9be3d539-b3c7-4bc7-9003-2776922d7bd0 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d.e6951f36-0665-479f-afa0-dac15382ce2f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:28 devstack sudo[106284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d.e6951f36-0665-479f-afa0-dac15382ce2f
Sep 07 18:20:28 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:28 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d35737dc-dafb-435b-bd12-d4c1d0541f56 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-7149464e-ad49-42dd-b63f-a7aad6b08499" returned: 0 in 0.288s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d35737dc-dafb-435b-bd12-d4c1d0541f56 tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-7149464e-ad49-42dd-b63f-a7aad6b08499" released by "delete_volume" :: held 0.806s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:28 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-d35737dc-dafb-435b-bd12-d4c1d0541f56 tempest-ProjectReaderTests-554049164 None] Created reservations ['ade3fd42-a466-48e1-976e-9c9a43cada3c', '64016eb3-367e-4e7c-8dcc-290589d4c42e', '5d0be478-8e56-47ab-aa9c-608065dc92c5', 'fa54cf9f-3f4d-4593-a5f7-2f4f2eb11506'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d35737dc-dafb-435b-bd12-d4c1d0541f56 tempest-ProjectReaderTests-554049164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d35737dc-dafb-435b-bd12-d4c1d0541f56 tempest-ProjectReaderTests-554049164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d35737dc-dafb-435b-bd12-d4c1d0541f56 tempest-ProjectReaderTests-554049164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:28 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-d35737dc-dafb-435b-bd12-d4c1d0541f56 tempest-ProjectReaderTests-554049164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-d35737dc-dafb-435b-bd12-d4c1d0541f56 tempest-ProjectReaderTests-554049164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d35737dc-dafb-435b-bd12-d4c1d0541f56 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:28 devstack sudo[106288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:20:28 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:28 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9be3d539-b3c7-4bc7-9003-2776922d7bd0 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d.e6951f36-0665-479f-afa0-dac15382ce2f" returned: 0 in 0.416s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9be3d539-b3c7-4bc7-9003-2776922d7bd0 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d.e6951f36-0665-479f-afa0-dac15382ce2f {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:28 devstack sudo[106293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d.e6951f36-0665-479f-afa0-dac15382ce2f
Sep 07 18:20:28 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:28 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-d35737dc-dafb-435b-bd12-d4c1d0541f56 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.291s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:28 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-d35737dc-dafb-435b-bd12-d4c1d0541f56 tempest-ProjectReaderTests-554049164 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:20:28 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-d35737dc-dafb-435b-bd12-d4c1d0541f56 tempest-ProjectReaderTests-554049164 None] Deleted volume successfully.
Sep 07 18:20:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-d35737dc-dafb-435b-bd12-d4c1d0541f56 tempest-ProjectReaderTests-554049164 None] Lock "cinder-7149464e-ad49-42dd-b63f-a7aad6b08499-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:28 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:28 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9be3d539-b3c7-4bc7-9003-2776922d7bd0 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d.e6951f36-0665-479f-afa0-dac15382ce2f" returned: 0 in 0.325s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9be3d539-b3c7-4bc7-9003-2776922d7bd0 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-e6951f36-0665-479f-afa0-dac15382ce2f" released by "_delete_snapshot" :: held 1.648s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9be3d539-b3c7-4bc7-9003-2776922d7bd0 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-faafd390-2a5d-4b96-bdd2-a89ea89db71d" released by "delete_snapshot" :: held 1.678s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:28 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-9be3d539-b3c7-4bc7-9003-2776922d7bd0 tempest-ProjectMemberTests-442300356 None] Created reservations ['a55101e9-176d-49cd-beec-9f44fee94690', '19f0731d-65ab-417f-b21f-753d77250bb0', 'e0f50d88-156a-4f3f-b939-9335c9cf3d60', '53b9659f-f00c-45f4-9689-6ac33525f9ba'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:28 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9be3d539-b3c7-4bc7-9003-2776922d7bd0 tempest-ProjectMemberTests-442300356 None] Delete snapshot completed successfully.
Sep 07 18:20:28 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-9be3d539-b3c7-4bc7-9003-2776922d7bd0 tempest-ProjectMemberTests-442300356 None] Lock "cinder-e6951f36-0665-479f-afa0-dac15382ce2f-delete_snapshot" released by "delete_snapshot" :: held 1.839s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Flow 'volume_create_manager' (c96c6e8a-769f-4ed0-ba46-2a412ae4cf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (456698e6-f022-4508-8545-8266b5667afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (456698e6-f022-4508-8545-8266b5667afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-175938169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f113e928-8fff-4416-9d5d-d6e1265a0483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122955d74f7a41f483601df502229750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:29Z,use_quota=True,user_id='91f34d73a70e42a797d7d3ec9310ed72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8834d4af-45e5-489a-a1c1-48c6aa1864ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8834d4af-45e5-489a-a1c1-48c6aa1864ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ddce93-7684-4027-a217-40a88e70e695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ddce93-7684-4027-a217-40a88e70e695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f113e928-8fff-4416-9d5d-d6e1265a0483', 'volume_name': 'volume-f113e928-8fff-4416-9d5d-d6e1265a0483', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151cc8db-bdeb-4fe5-bfe5-55ea71de7b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151cc8db-bdeb-4fe5-bfe5-55ea71de7b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c6831bc-983c-4224-8d0e-bfc3bddd8854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:29 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Volume f113e928-8fff-4416-9d5d-d6e1265a0483: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f113e928-8fff-4416-9d5d-d6e1265a0483', 'volume_size': 1}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-175938169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f113e928-8fff-4416-9d5d-d6e1265a0483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122955d74f7a41f483601df502229750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:29Z,use_quota=True,user_id='91f34d73a70e42a797d7d3ec9310ed72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Creating volume f113e928-8fff-4416-9d5d-d6e1265a0483 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:20:29 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a59b44fe-5427-476e-afcb-dab13a802277 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-faafd390-2a5d-4b96-bdd2-a89ea89db71d-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:29 devstack sudo[106297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483 1073741824
Sep 07 18:20:29 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a59b44fe-5427-476e-afcb-dab13a802277 tempest-ProjectMemberTests-442300356 None] Lock "cinder-faafd390-2a5d-4b96-bdd2-a89ea89db71d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a59b44fe-5427-476e-afcb-dab13a802277 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-quobyte-faafd390-2a5d-4b96-bdd2-a89ea89db71d" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a59b44fe-5427-476e-afcb-dab13a802277 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-faafd390-2a5d-4b96-bdd2-a89ea89db71d" acquired by "delete_volume" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bab74c-9bc3-4f0f-ae99-062251d99ea1]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a59b44fe-5427-476e-afcb-dab13a802277 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:29 devstack sudo[106299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d
Sep 07 18:20:29 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:29 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483 1073741824" returned: 0 in 0.513s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:29 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a59b44fe-5427-476e-afcb-dab13a802277 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d" returned: 0 in 0.466s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:29 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a59b44fe-5427-476e-afcb-dab13a802277 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:29 devstack sudo[106308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483
Sep 07 18:20:29 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:29 devstack sudo[106310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d
Sep 07 18:20:29 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:30 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483" returned: 0 in 0.302s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:30 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c6831bc-983c-4224-8d0e-bfc3bddd8854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f113e928-8fff-4416-9d5d-d6e1265a0483', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df26693-814d-4bc3-aad8-e82100b6d744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a59b44fe-5427-476e-afcb-dab13a802277 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-faafd390-2a5d-4b96-bdd2-a89ea89db71d" returned: 0 in 0.312s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a59b44fe-5427-476e-afcb-dab13a802277 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-faafd390-2a5d-4b96-bdd2-a89ea89db71d" released by "delete_volume" :: held 0.847s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:30 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Volume volume-f113e928-8fff-4416-9d5d-d6e1265a0483 (f113e928-8fff-4416-9d5d-d6e1265a0483): created successfully
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df26693-814d-4bc3-aad8-e82100b6d744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Flow 'volume_create_manager' (c96c6e8a-769f-4ed0-ba46-2a412ae4cf2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:30 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-c86054a8-461f-422d-b45d-34e0aa43c10d tempest-ProjectReaderTests-554049164 None] Created volume successfully.
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-a59b44fe-5427-476e-afcb-dab13a802277 tempest-ProjectMemberTests-442300356 None] Created reservations ['63c8601e-6fe0-4408-b59e-4831858baf90', '2de57b9a-5747-4ca4-b3ee-36f002be951c', '8cb06381-2c6d-42bc-ba05-602e124893f3', '19bae4cf-2672-487a-b81c-4ca9cabd4ee7'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a59b44fe-5427-476e-afcb-dab13a802277 tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a59b44fe-5427-476e-afcb-dab13a802277 tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a59b44fe-5427-476e-afcb-dab13a802277 tempest-ProjectMemberTests-442300356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-a59b44fe-5427-476e-afcb-dab13a802277 tempest-ProjectMemberTests-442300356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a59b44fe-5427-476e-afcb-dab13a802277 tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a59b44fe-5427-476e-afcb-dab13a802277 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:30 devstack sudo[106314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:20:30 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:30 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a59b44fe-5427-476e-afcb-dab13a802277 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.279s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-a59b44fe-5427-476e-afcb-dab13a802277 tempest-ProjectMemberTests-442300356 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:20:30 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a59b44fe-5427-476e-afcb-dab13a802277 tempest-ProjectMemberTests-442300356 None] Deleted volume successfully.
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-a59b44fe-5427-476e-afcb-dab13a802277 tempest-ProjectMemberTests-442300356 None] Lock "cinder-faafd390-2a5d-4b96-bdd2-a89ea89db71d-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Flow 'volume_create_manager' (8365fe3e-3042-4b36-a2f3-a7a307188cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc6321b7-d09f-4929-b740-afa9e9d923fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc6321b7-d09f-4929-b740-afa9e9d923fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1576041251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb91b14-4dc6-454c-a900-25048b1d3c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e449daccfbab4cd8ba38df886cea84bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:31Z,use_quota=True,user_id='d0204c187bcf4a5ba9582bac88f452df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b0db7e-c3f4-430d-95f6-7c08f1153865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b0db7e-c3f4-430d-95f6-7c08f1153865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d24c280-d1a5-4974-8657-09f0627a3c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d24c280-d1a5-4974-8657-09f0627a3c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeb91b14-4dc6-454c-a900-25048b1d3c39', 'volume_name': 'volume-aeb91b14-4dc6-454c-a900-25048b1d3c39', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43093152-0737-4849-a2e8-4ace4b2c2cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43093152-0737-4849-a2e8-4ace4b2c2cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432d5858-ac1d-41d6-aa65-6e6c1d661544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:30 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Volume aeb91b14-4dc6-454c-a900-25048b1d3c39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeb91b14-4dc6-454c-a900-25048b1d3c39', 'volume_size': 1}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1576041251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb91b14-4dc6-454c-a900-25048b1d3c39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e449daccfbab4cd8ba38df886cea84bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:31Z,use_quota=True,user_id='d0204c187bcf4a5ba9582bac88f452df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Creating volume aeb91b14-4dc6-454c-a900-25048b1d3c39 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:20:30 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:20:30 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:31 devstack sudo[106318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39 1073741824
Sep 07 18:20:31 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9c7a02b3-1423-4a7d-9cd2-9c28832e920d tempest-ProjectReaderTests-554049164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:31 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39 1073741824" returned: 0 in 0.494s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:31 devstack sudo[106324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39
Sep 07 18:20:31 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:31 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39" returned: 0 in 0.239s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:20:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9c7a02b3-1423-4a7d-9cd2-9c28832e920d tempest-ProjectReaderTests-554049164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.366s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:31 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-9c7a02b3-1423-4a7d-9cd2-9c28832e920d tempest-ProjectReaderTests-554049164 None] Creating offline snapshot cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31 of volume f113e928-8fff-4416-9d5d-d6e1265a0483 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:20:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (432d5858-ac1d-41d6-aa65-6e6c1d661544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeb91b14-4dc6-454c-a900-25048b1d3c39', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543a7d35-2207-47b1-9767-045e0ffeec2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:31 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebc149a-99df-46a3-864d-10a0f2b84cd0]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:31 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c7a02b3-1423-4a7d-9cd2-9c28832e920d tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:31 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Volume volume-aeb91b14-4dc6-454c-a900-25048b1d3c39 (aeb91b14-4dc6-454c-a900-25048b1d3c39): created successfully
Sep 07 18:20:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543a7d35-2207-47b1-9767-045e0ffeec2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:31 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Flow 'volume_create_manager' (8365fe3e-3042-4b36-a2f3-a7a307188cbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:31 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-8bf532a0-26be-4005-8ac5-2fab50aaa124 tempest-ProjectMemberTests-442300356 None] Created volume successfully.
Sep 07 18:20:31 devstack sudo[106327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483
Sep 07 18:20:31 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:32 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c7a02b3-1423-4a7d-9cd2-9c28832e920d tempest-ProjectReaderTests-554049164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483" returned: 0 in 0.396s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c7a02b3-1423-4a7d-9cd2-9c28832e920d tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483.cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:32 devstack sudo[106333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483.cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31 1G
Sep 07 18:20:32 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:32 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c7a02b3-1423-4a7d-9cd2-9c28832e920d tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483.cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31 1G" returned: 0 in 0.395s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c7a02b3-1423-4a7d-9cd2-9c28832e920d tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f113e928-8fff-4416-9d5d-d6e1265a0483 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483.cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:32 devstack sudo[106339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f113e928-8fff-4416-9d5d-d6e1265a0483 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483.cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31
Sep 07 18:20:32 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:32 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c7a02b3-1423-4a7d-9cd2-9c28832e920d tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f113e928-8fff-4416-9d5d-d6e1265a0483 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483.cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31" returned: 0 in 0.294s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:32 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-9c7a02b3-1423-4a7d-9cd2-9c28832e920d tempest-ProjectReaderTests-554049164 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483.cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31 is being set with open permissions: ugo+rw
Sep 07 18:20:32 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c7a02b3-1423-4a7d-9cd2-9c28832e920d tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483.cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:32 devstack sudo[106344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483.cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31
Sep 07 18:20:32 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-107e5532-7721-46c7-8a77-e550ac402454 tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:33 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c7a02b3-1423-4a7d-9cd2-9c28832e920d tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483.cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31" returned: 0 in 0.303s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c7a02b3-1423-4a7d-9cd2-9c28832e920d tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:33 devstack sudo[106347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483.info
Sep 07 18:20:33 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:33 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c7a02b3-1423-4a7d-9cd2-9c28832e920d tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483.info" returned: 0 in 0.249s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:33 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-9c7a02b3-1423-4a7d-9cd2-9c28832e920d tempest-ProjectReaderTests-554049164 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483.info is being set with open permissions: ugo+rw
Sep 07 18:20:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c7a02b3-1423-4a7d-9cd2-9c28832e920d tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:33 devstack sudo[106350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483.info
Sep 07 18:20:33 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:33 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-9c7a02b3-1423-4a7d-9cd2-9c28832e920d tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483.info" returned: 0 in 0.240s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-9c7a02b3-1423-4a7d-9cd2-9c28832e920d tempest-ProjectReaderTests-554049164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.968s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-107e5532-7721-46c7-8a77-e550ac402454 tempest-ProjectMemberTests-442300356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.558s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:33 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-107e5532-7721-46c7-8a77-e550ac402454 tempest-ProjectMemberTests-442300356 None] Creating offline snapshot f8871ed7-0e1c-4c17-b0b5-eb06451243df of volume aeb91b14-4dc6-454c-a900-25048b1d3c39 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:20:33 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd18f1f-8a72-4769-aed3-686bffefe7ed]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:33 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-107e5532-7721-46c7-8a77-e550ac402454 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:33 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-9c7a02b3-1423-4a7d-9cd2-9c28832e920d tempest-ProjectReaderTests-554049164 None] Create snapshot completed successfully
Sep 07 18:20:33 devstack sudo[106353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39
Sep 07 18:20:33 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:34 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-107e5532-7721-46c7-8a77-e550ac402454 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39" returned: 0 in 0.408s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-107e5532-7721-46c7-8a77-e550ac402454 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39.f8871ed7-0e1c-4c17-b0b5-eb06451243df 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:34 devstack sudo[106358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39.f8871ed7-0e1c-4c17-b0b5-eb06451243df 1G
Sep 07 18:20:34 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-15f439ce-9ef6-4a69-8f7d-5fe6e51e4759 tempest-ProjectReaderTests-554049164 None] Acquiring lock "cinder-cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-15f439ce-9ef6-4a69-8f7d-5fe6e51e4759 tempest-ProjectReaderTests-554049164 None] Lock "cinder-cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-15f439ce-9ef6-4a69-8f7d-5fe6e51e4759 tempest-ProjectReaderTests-554049164 None] Acquiring lock "cinder-quobyte-f113e928-8fff-4416-9d5d-d6e1265a0483" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-15f439ce-9ef6-4a69-8f7d-5fe6e51e4759 tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-f113e928-8fff-4416-9d5d-d6e1265a0483" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-15f439ce-9ef6-4a69-8f7d-5fe6e51e4759 tempest-ProjectReaderTests-554049164 None] Acquiring lock "cinder-quobyte-cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:34 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-15f439ce-9ef6-4a69-8f7d-5fe6e51e4759 tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-15f439ce-9ef6-4a69-8f7d-5fe6e51e4759 tempest-ProjectReaderTests-554049164 None] Deleting offline snapshot cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31 of volume f113e928-8fff-4416-9d5d-d6e1265a0483 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:20:34 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-15f439ce-9ef6-4a69-8f7d-5fe6e51e4759 tempest-ProjectReaderTests-554049164 None] snapshot_file for this snap is: volume-f113e928-8fff-4416-9d5d-d6e1265a0483.cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:20:34 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-107e5532-7721-46c7-8a77-e550ac402454 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39.f8871ed7-0e1c-4c17-b0b5-eb06451243df 1G" returned: 0 in 0.513s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-107e5532-7721-46c7-8a77-e550ac402454 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeb91b14-4dc6-454c-a900-25048b1d3c39 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39.f8871ed7-0e1c-4c17-b0b5-eb06451243df {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:34 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[819e3d22-a91b-4857-950f-82e31d3d7600]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:34 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-15f439ce-9ef6-4a69-8f7d-5fe6e51e4759 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483.cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:34 devstack sudo[106364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeb91b14-4dc6-454c-a900-25048b1d3c39 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39.f8871ed7-0e1c-4c17-b0b5-eb06451243df
Sep 07 18:20:34 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:34 devstack sudo[106365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483.cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31
Sep 07 18:20:34 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:35 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-107e5532-7721-46c7-8a77-e550ac402454 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeb91b14-4dc6-454c-a900-25048b1d3c39 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39.f8871ed7-0e1c-4c17-b0b5-eb06451243df" returned: 0 in 0.365s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:35 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-107e5532-7721-46c7-8a77-e550ac402454 tempest-ProjectMemberTests-442300356 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39.f8871ed7-0e1c-4c17-b0b5-eb06451243df is being set with open permissions: ugo+rw
Sep 07 18:20:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-107e5532-7721-46c7-8a77-e550ac402454 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39.f8871ed7-0e1c-4c17-b0b5-eb06451243df {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:35 devstack sudo[106373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39.f8871ed7-0e1c-4c17-b0b5-eb06451243df
Sep 07 18:20:35 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:35 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-15f439ce-9ef6-4a69-8f7d-5fe6e51e4759 tempest-ProjectReaderTests-554049164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483.cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31" returned: 0 in 0.431s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:35 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-15f439ce-9ef6-4a69-8f7d-5fe6e51e4759 tempest-ProjectReaderTests-554049164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f113e928-8fff-4416-9d5d-d6e1265a0483(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:20:35 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c58704-91f7-46bb-bb87-30162e80d223]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-15f439ce-9ef6-4a69-8f7d-5fe6e51e4759 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:35 devstack sudo[106377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483
Sep 07 18:20:35 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:35 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-107e5532-7721-46c7-8a77-e550ac402454 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39.f8871ed7-0e1c-4c17-b0b5-eb06451243df" returned: 0 in 0.283s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-107e5532-7721-46c7-8a77-e550ac402454 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:35 devstack sudo[106381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39.info
Sep 07 18:20:35 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:35 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-15f439ce-9ef6-4a69-8f7d-5fe6e51e4759 tempest-ProjectReaderTests-554049164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483" returned: 0 in 0.431s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-15f439ce-9ef6-4a69-8f7d-5fe6e51e4759 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483.cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:35 devstack sudo[106386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483.cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31
Sep 07 18:20:35 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:35 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-107e5532-7721-46c7-8a77-e550ac402454 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39.info" returned: 0 in 0.310s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:35 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-107e5532-7721-46c7-8a77-e550ac402454 tempest-ProjectMemberTests-442300356 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39.info is being set with open permissions: ugo+rw
Sep 07 18:20:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-107e5532-7721-46c7-8a77-e550ac402454 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:35 devstack sudo[106389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39.info
Sep 07 18:20:35 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:35 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:35 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-15f439ce-9ef6-4a69-8f7d-5fe6e51e4759 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483.cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31" returned: 0 in 0.371s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-15f439ce-9ef6-4a69-8f7d-5fe6e51e4759 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483.cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:35 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-107e5532-7721-46c7-8a77-e550ac402454 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39.info" returned: 0 in 0.295s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:35 devstack sudo[106395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483.cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31
Sep 07 18:20:35 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-107e5532-7721-46c7-8a77-e550ac402454 tempest-ProjectMemberTests-442300356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.283s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:36 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-107e5532-7721-46c7-8a77-e550ac402454 tempest-ProjectMemberTests-442300356 None] Create snapshot completed successfully
Sep 07 18:20:36 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-15f439ce-9ef6-4a69-8f7d-5fe6e51e4759 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483.cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31" returned: 0 in 0.263s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-15f439ce-9ef6-4a69-8f7d-5fe6e51e4759 tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31" released by "_delete_snapshot" :: held 1.625s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-15f439ce-9ef6-4a69-8f7d-5fe6e51e4759 tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-f113e928-8fff-4416-9d5d-d6e1265a0483" released by "delete_snapshot" :: held 1.650s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:36 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-15f439ce-9ef6-4a69-8f7d-5fe6e51e4759 tempest-ProjectReaderTests-554049164 None] Created reservations ['1352408a-2133-4bf2-b107-957ed33bc3cd', '56d86270-1da8-453c-a1ea-921e51c3abfc', '337dde79-1d39-4d75-950e-6bc3d7e8f7ac', 'd37d4f1e-ef31-4e61-a9b5-eddfdc1d6902'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c2bf1916-56b1-46f2-aba4-317845de14e0 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-f8871ed7-0e1c-4c17-b0b5-eb06451243df-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c2bf1916-56b1-46f2-aba4-317845de14e0 tempest-ProjectMemberTests-442300356 None] Lock "cinder-f8871ed7-0e1c-4c17-b0b5-eb06451243df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c2bf1916-56b1-46f2-aba4-317845de14e0 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-quobyte-aeb91b14-4dc6-454c-a900-25048b1d3c39" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c2bf1916-56b1-46f2-aba4-317845de14e0 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-aeb91b14-4dc6-454c-a900-25048b1d3c39" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c2bf1916-56b1-46f2-aba4-317845de14e0 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-quobyte-f8871ed7-0e1c-4c17-b0b5-eb06451243df" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:36 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-15f439ce-9ef6-4a69-8f7d-5fe6e51e4759 tempest-ProjectReaderTests-554049164 None] Delete snapshot completed successfully.
Sep 07 18:20:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c2bf1916-56b1-46f2-aba4-317845de14e0 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-f8871ed7-0e1c-4c17-b0b5-eb06451243df" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-c2bf1916-56b1-46f2-aba4-317845de14e0 tempest-ProjectMemberTests-442300356 None] Deleting offline snapshot f8871ed7-0e1c-4c17-b0b5-eb06451243df of volume aeb91b14-4dc6-454c-a900-25048b1d3c39 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:20:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-c2bf1916-56b1-46f2-aba4-317845de14e0 tempest-ProjectMemberTests-442300356 None] snapshot_file for this snap is: volume-aeb91b14-4dc6-454c-a900-25048b1d3c39.f8871ed7-0e1c-4c17-b0b5-eb06451243df {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:20:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-15f439ce-9ef6-4a69-8f7d-5fe6e51e4759 tempest-ProjectReaderTests-554049164 None] Lock "cinder-cda81d71-7a6e-4e9e-b7b8-1489c1ac6e31-delete_snapshot" released by "delete_snapshot" :: held 1.887s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:36 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce27ce79-268f-41f8-bf6d-6f376608f8e9]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c2bf1916-56b1-46f2-aba4-317845de14e0 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39.f8871ed7-0e1c-4c17-b0b5-eb06451243df {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:36 devstack sudo[106399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39.f8871ed7-0e1c-4c17-b0b5-eb06451243df
Sep 07 18:20:36 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-96f3df4b-b476-4879-bd99-2c0bcad20c7a tempest-ProjectReaderTests-554049164 None] Acquiring lock "cinder-f113e928-8fff-4416-9d5d-d6e1265a0483-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-96f3df4b-b476-4879-bd99-2c0bcad20c7a tempest-ProjectReaderTests-554049164 None] Lock "cinder-f113e928-8fff-4416-9d5d-d6e1265a0483-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-96f3df4b-b476-4879-bd99-2c0bcad20c7a tempest-ProjectReaderTests-554049164 None] Acquiring lock "cinder-quobyte-f113e928-8fff-4416-9d5d-d6e1265a0483" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:36 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-96f3df4b-b476-4879-bd99-2c0bcad20c7a tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-f113e928-8fff-4416-9d5d-d6e1265a0483" acquired by "delete_volume" :: waited 0.027s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:36 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d316562e-27cb-4080-aea2-58721a4d7bf9]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-96f3df4b-b476-4879-bd99-2c0bcad20c7a tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:36 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c2bf1916-56b1-46f2-aba4-317845de14e0 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39.f8871ed7-0e1c-4c17-b0b5-eb06451243df" returned: 0 in 0.394s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:36 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-c2bf1916-56b1-46f2-aba4-317845de14e0 tempest-ProjectMemberTests-442300356 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeb91b14-4dc6-454c-a900-25048b1d3c39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:20:36 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e724e55-8a13-43af-a550-2340a247d38c]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:36 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c2bf1916-56b1-46f2-aba4-317845de14e0 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:37 devstack sudo[106404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483
Sep 07 18:20:37 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:37 devstack sudo[106405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39
Sep 07 18:20:37 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:37 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-96f3df4b-b476-4879-bd99-2c0bcad20c7a tempest-ProjectReaderTests-554049164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483" returned: 0 in 0.377s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-96f3df4b-b476-4879-bd99-2c0bcad20c7a tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:37 devstack sudo[106413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483
Sep 07 18:20:37 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:37 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c2bf1916-56b1-46f2-aba4-317845de14e0 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39" returned: 0 in 0.381s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c2bf1916-56b1-46f2-aba4-317845de14e0 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39.f8871ed7-0e1c-4c17-b0b5-eb06451243df {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:37 devstack sudo[106417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39.f8871ed7-0e1c-4c17-b0b5-eb06451243df
Sep 07 18:20:37 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:37 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-96f3df4b-b476-4879-bd99-2c0bcad20c7a tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-f113e928-8fff-4416-9d5d-d6e1265a0483" returned: 0 in 0.255s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-96f3df4b-b476-4879-bd99-2c0bcad20c7a tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-f113e928-8fff-4416-9d5d-d6e1265a0483" released by "delete_volume" :: held 0.687s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:37 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-96f3df4b-b476-4879-bd99-2c0bcad20c7a tempest-ProjectReaderTests-554049164 None] Created reservations ['c86066dc-8ad2-4403-8de0-9948530c2b3e', '02895cab-5930-48cf-b5ee-d127e80afece', 'eacd8eb8-ca7f-43cb-bf4e-8dd3da8f9c09', 'aa5de1f3-87e0-4777-8467-604f2405f334'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-96f3df4b-b476-4879-bd99-2c0bcad20c7a tempest-ProjectReaderTests-554049164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-96f3df4b-b476-4879-bd99-2c0bcad20c7a tempest-ProjectReaderTests-554049164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-96f3df4b-b476-4879-bd99-2c0bcad20c7a tempest-ProjectReaderTests-554049164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:37 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-96f3df4b-b476-4879-bd99-2c0bcad20c7a tempest-ProjectReaderTests-554049164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-96f3df4b-b476-4879-bd99-2c0bcad20c7a tempest-ProjectReaderTests-554049164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-96f3df4b-b476-4879-bd99-2c0bcad20c7a tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:37 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c2bf1916-56b1-46f2-aba4-317845de14e0 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39.f8871ed7-0e1c-4c17-b0b5-eb06451243df" returned: 0 in 0.361s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c2bf1916-56b1-46f2-aba4-317845de14e0 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39.f8871ed7-0e1c-4c17-b0b5-eb06451243df {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:37 devstack sudo[106423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:20:37 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:37 devstack sudo[106425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39.f8871ed7-0e1c-4c17-b0b5-eb06451243df
Sep 07 18:20:37 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:37 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-96f3df4b-b476-4879-bd99-2c0bcad20c7a tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.261s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:37 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-96f3df4b-b476-4879-bd99-2c0bcad20c7a tempest-ProjectReaderTests-554049164 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:20:37 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-96f3df4b-b476-4879-bd99-2c0bcad20c7a tempest-ProjectReaderTests-554049164 None] Deleted volume successfully.
Sep 07 18:20:37 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:37 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-c2bf1916-56b1-46f2-aba4-317845de14e0 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39.f8871ed7-0e1c-4c17-b0b5-eb06451243df" returned: 0 in 0.264s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c2bf1916-56b1-46f2-aba4-317845de14e0 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-f8871ed7-0e1c-4c17-b0b5-eb06451243df" released by "_delete_snapshot" :: held 1.512s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-96f3df4b-b476-4879-bd99-2c0bcad20c7a tempest-ProjectReaderTests-554049164 None] Lock "cinder-f113e928-8fff-4416-9d5d-d6e1265a0483-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:37 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c2bf1916-56b1-46f2-aba4-317845de14e0 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-aeb91b14-4dc6-454c-a900-25048b1d3c39" released by "delete_snapshot" :: held 1.544s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-c2bf1916-56b1-46f2-aba4-317845de14e0 tempest-ProjectMemberTests-442300356 None] Created reservations ['9721707c-a6a5-4ead-b412-ad8b0ee1b256', 'ef30e152-af8d-432f-af54-64b218fb95c4', '1e8e41b8-9bed-484b-bc13-db7e358e5e6d', '4bc12bfe-2f60-4e0e-b1f6-d7616c8acc7a'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:38 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-c2bf1916-56b1-46f2-aba4-317845de14e0 tempest-ProjectMemberTests-442300356 None] Delete snapshot completed successfully.
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-c2bf1916-56b1-46f2-aba4-317845de14e0 tempest-ProjectMemberTests-442300356 None] Lock "cinder-f8871ed7-0e1c-4c17-b0b5-eb06451243df-delete_snapshot" released by "delete_snapshot" :: held 1.710s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Flow 'volume_create_manager' (941a6b95-fb16-430d-9d91-851c58e9d052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45eca7e4-fa10-434d-bea4-214daac36eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45eca7e4-fa10-434d-bea4-214daac36eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-582223448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437ca458-9135-47bd-9ba9-f9b9f78e8a33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122955d74f7a41f483601df502229750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:38Z,use_quota=True,user_id='91f34d73a70e42a797d7d3ec9310ed72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f78ba81-f8f2-44b6-8055-e8a0bafc0732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f78ba81-f8f2-44b6-8055-e8a0bafc0732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b48f59be-3f0e-4f29-844b-3ff70b4bce47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b48f59be-3f0e-4f29-844b-3ff70b4bce47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '437ca458-9135-47bd-9ba9-f9b9f78e8a33', 'volume_name': 'volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73bf7d8-9009-4ece-ba76-fbc00f54e355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73bf7d8-9009-4ece-ba76-fbc00f54e355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f6ca0f-ed53-4b9b-a9ae-61ae799bf5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:38 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Volume 437ca458-9135-47bd-9ba9-f9b9f78e8a33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33', 'volume_size': 1}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-582223448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437ca458-9135-47bd-9ba9-f9b9f78e8a33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122955d74f7a41f483601df502229750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:38Z,use_quota=True,user_id='91f34d73a70e42a797d7d3ec9310ed72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Creating volume 437ca458-9135-47bd-9ba9-f9b9f78e8a33 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:20:38 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:38 devstack sudo[106432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33 1073741824
Sep 07 18:20:38 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-de6c7f4f-f95e-42e5-8464-f505d8c6bfb2 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-aeb91b14-4dc6-454c-a900-25048b1d3c39-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-de6c7f4f-f95e-42e5-8464-f505d8c6bfb2 tempest-ProjectMemberTests-442300356 None] Lock "cinder-aeb91b14-4dc6-454c-a900-25048b1d3c39-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-de6c7f4f-f95e-42e5-8464-f505d8c6bfb2 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-quobyte-aeb91b14-4dc6-454c-a900-25048b1d3c39" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-de6c7f4f-f95e-42e5-8464-f505d8c6bfb2 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-aeb91b14-4dc6-454c-a900-25048b1d3c39" acquired by "delete_volume" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d49558-5135-47a8-9474-ea7e3d8362e0]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-de6c7f4f-f95e-42e5-8464-f505d8c6bfb2 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:38 devstack sudo[106434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39
Sep 07 18:20:38 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:38 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33 1073741824" returned: 0 in 0.429s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:38 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:38 devstack sudo[106440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33
Sep 07 18:20:38 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:39 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-de6c7f4f-f95e-42e5-8464-f505d8c6bfb2 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39" returned: 0 in 0.383s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-de6c7f4f-f95e-42e5-8464-f505d8c6bfb2 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:39 devstack sudo[106445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39
Sep 07 18:20:39 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:39 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33" returned: 0 in 0.251s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:20:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2f6ca0f-ed53-4b9b-a9ae-61ae799bf5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c4fd5a0-11b2-4e82-ba46-d857ba73c2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:39 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Volume volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33 (437ca458-9135-47bd-9ba9-f9b9f78e8a33): created successfully
Sep 07 18:20:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c4fd5a0-11b2-4e82-ba46-d857ba73c2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:39 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Flow 'volume_create_manager' (941a6b95-fb16-430d-9d91-851c58e9d052) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:39 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ded46695-37d1-4ff7-9ee0-e791ff9932ed tempest-ProjectReaderTests-554049164 None] Created volume successfully.
Sep 07 18:20:39 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-de6c7f4f-f95e-42e5-8464-f505d8c6bfb2 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-aeb91b14-4dc6-454c-a900-25048b1d3c39" returned: 0 in 0.252s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-de6c7f4f-f95e-42e5-8464-f505d8c6bfb2 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-aeb91b14-4dc6-454c-a900-25048b1d3c39" released by "delete_volume" :: held 0.700s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:39 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-de6c7f4f-f95e-42e5-8464-f505d8c6bfb2 tempest-ProjectMemberTests-442300356 None] Created reservations ['3ec977cf-93c0-4553-8e12-bfcb9668d7a4', '4cc91cc0-46d7-4fea-8469-05bc1baf9d4e', 'f761843b-9b62-4a24-9741-b4f109980200', '600e7657-668a-4717-b503-3f98c9307017'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-de6c7f4f-f95e-42e5-8464-f505d8c6bfb2 tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-de6c7f4f-f95e-42e5-8464-f505d8c6bfb2 tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-de6c7f4f-f95e-42e5-8464-f505d8c6bfb2 tempest-ProjectMemberTests-442300356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-de6c7f4f-f95e-42e5-8464-f505d8c6bfb2 tempest-ProjectMemberTests-442300356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-de6c7f4f-f95e-42e5-8464-f505d8c6bfb2 tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-de6c7f4f-f95e-42e5-8464-f505d8c6bfb2 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:39 devstack sudo[106449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:20:39 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-937df177-6233-4e85-8d11-93d4c0ba55a6 tempest-ProjectReaderTests-554049164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-937df177-6233-4e85-8d11-93d4c0ba55a6 tempest-ProjectReaderTests-554049164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:39 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-937df177-6233-4e85-8d11-93d4c0ba55a6 tempest-ProjectReaderTests-554049164 None] Creating offline snapshot e0ad79c5-3acb-489e-9bb1-1b7ef3d98379 of volume 437ca458-9135-47bd-9ba9-f9b9f78e8a33 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:20:39 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[36481046-63d7-45e0-b96b-07ccf6be320b]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-937df177-6233-4e85-8d11-93d4c0ba55a6 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:39 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:39 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-de6c7f4f-f95e-42e5-8464-f505d8c6bfb2 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.288s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:39 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-de6c7f4f-f95e-42e5-8464-f505d8c6bfb2 tempest-ProjectMemberTests-442300356 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:20:39 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-de6c7f4f-f95e-42e5-8464-f505d8c6bfb2 tempest-ProjectMemberTests-442300356 None] Deleted volume successfully.
Sep 07 18:20:39 devstack sudo[106451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33
Sep 07 18:20:39 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:39 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-de6c7f4f-f95e-42e5-8464-f505d8c6bfb2 tempest-ProjectMemberTests-442300356 None] Lock "cinder-aeb91b14-4dc6-454c-a900-25048b1d3c39-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:40 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-937df177-6233-4e85-8d11-93d4c0ba55a6 tempest-ProjectReaderTests-554049164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33" returned: 0 in 0.417s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-937df177-6233-4e85-8d11-93d4c0ba55a6 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33.e0ad79c5-3acb-489e-9bb1-1b7ef3d98379 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:40 devstack sudo[106457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33.e0ad79c5-3acb-489e-9bb1-1b7ef3d98379 1G
Sep 07 18:20:40 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:40 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:20:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Flow 'volume_create_manager' (207bf06f-2712-453b-8ea7-fed3a058526c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57da77c6-4fb0-4965-9905-3fe733db97e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57da77c6-4fb0-4965-9905-3fe733db97e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-855794809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c2a2986-429c-45fe-8b36-c459355fc1f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e449daccfbab4cd8ba38df886cea84bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:40Z,use_quota=True,user_id='d0204c187bcf4a5ba9582bac88f452df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f77e0e5d-772c-4ed1-a415-64f5d2d94bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f77e0e5d-772c-4ed1-a415-64f5d2d94bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3812e4fa-b7e4-466a-a1d8-6704af3eea14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3812e4fa-b7e4-466a-a1d8-6704af3eea14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c2a2986-429c-45fe-8b36-c459355fc1f2', 'volume_name': 'volume-1c2a2986-429c-45fe-8b36-c459355fc1f2', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e059c2b5-cf70-4947-baf6-f7b600655b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e059c2b5-cf70-4947-baf6-f7b600655b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:40 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b999bec0-60e9-4d90-ad88-996c5c452f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:40 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Volume 1c2a2986-429c-45fe-8b36-c459355fc1f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c2a2986-429c-45fe-8b36-c459355fc1f2', 'volume_size': 1}
Sep 07 18:20:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:40 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-937df177-6233-4e85-8d11-93d4c0ba55a6 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33.e0ad79c5-3acb-489e-9bb1-1b7ef3d98379 1G" returned: 0 in 0.390s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-937df177-6233-4e85-8d11-93d4c0ba55a6 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33.e0ad79c5-3acb-489e-9bb1-1b7ef3d98379 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:40 devstack sudo[106463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33.e0ad79c5-3acb-489e-9bb1-1b7ef3d98379
Sep 07 18:20:40 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:40 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-937df177-6233-4e85-8d11-93d4c0ba55a6 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33.e0ad79c5-3acb-489e-9bb1-1b7ef3d98379" returned: 0 in 0.280s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:40 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-937df177-6233-4e85-8d11-93d4c0ba55a6 tempest-ProjectReaderTests-554049164 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33.e0ad79c5-3acb-489e-9bb1-1b7ef3d98379 is being set with open permissions: ugo+rw
Sep 07 18:20:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-937df177-6233-4e85-8d11-93d4c0ba55a6 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33.e0ad79c5-3acb-489e-9bb1-1b7ef3d98379 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:40 devstack sudo[106469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33.e0ad79c5-3acb-489e-9bb1-1b7ef3d98379
Sep 07 18:20:40 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:40 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-937df177-6233-4e85-8d11-93d4c0ba55a6 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33.e0ad79c5-3acb-489e-9bb1-1b7ef3d98379" returned: 0 in 0.238s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:40 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-937df177-6233-4e85-8d11-93d4c0ba55a6 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:41 devstack sudo[106472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33.info
Sep 07 18:20:41 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:41 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-937df177-6233-4e85-8d11-93d4c0ba55a6 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33.info" returned: 0 in 0.245s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:41 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-937df177-6233-4e85-8d11-93d4c0ba55a6 tempest-ProjectReaderTests-554049164 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33.info is being set with open permissions: ugo+rw
Sep 07 18:20:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-937df177-6233-4e85-8d11-93d4c0ba55a6 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:41 devstack sudo[106475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33.info
Sep 07 18:20:41 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:41 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-937df177-6233-4e85-8d11-93d4c0ba55a6 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33.info" returned: 0 in 0.239s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-937df177-6233-4e85-8d11-93d4c0ba55a6 tempest-ProjectReaderTests-554049164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.884s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.222s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-855794809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c2a2986-429c-45fe-8b36-c459355fc1f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e449daccfbab4cd8ba38df886cea84bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:40Z,use_quota=True,user_id='d0204c187bcf4a5ba9582bac88f452df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:20:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Creating volume 1c2a2986-429c-45fe-8b36-c459355fc1f2 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:20:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:20:41 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:20:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:41 devstack sudo[106478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2 1073741824
Sep 07 18:20:41 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:41 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-937df177-6233-4e85-8d11-93d4c0ba55a6 tempest-ProjectReaderTests-554049164 None] Create snapshot completed successfully
Sep 07 18:20:41 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b870bfaa-3b86-4552-8285-13bae9b7b798 tempest-ProjectReaderTests-554049164 None] Acquiring lock "cinder-e0ad79c5-3acb-489e-9bb1-1b7ef3d98379-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:41 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b870bfaa-3b86-4552-8285-13bae9b7b798 tempest-ProjectReaderTests-554049164 None] Lock "cinder-e0ad79c5-3acb-489e-9bb1-1b7ef3d98379-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:41 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b870bfaa-3b86-4552-8285-13bae9b7b798 tempest-ProjectReaderTests-554049164 None] Acquiring lock "cinder-quobyte-437ca458-9135-47bd-9ba9-f9b9f78e8a33" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:41 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b870bfaa-3b86-4552-8285-13bae9b7b798 tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-437ca458-9135-47bd-9ba9-f9b9f78e8a33" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:41 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b870bfaa-3b86-4552-8285-13bae9b7b798 tempest-ProjectReaderTests-554049164 None] Acquiring lock "cinder-quobyte-e0ad79c5-3acb-489e-9bb1-1b7ef3d98379" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:41 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b870bfaa-3b86-4552-8285-13bae9b7b798 tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-e0ad79c5-3acb-489e-9bb1-1b7ef3d98379" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-b870bfaa-3b86-4552-8285-13bae9b7b798 tempest-ProjectReaderTests-554049164 None] Deleting offline snapshot e0ad79c5-3acb-489e-9bb1-1b7ef3d98379 of volume 437ca458-9135-47bd-9ba9-f9b9f78e8a33 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:20:41 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-b870bfaa-3b86-4552-8285-13bae9b7b798 tempest-ProjectReaderTests-554049164 None] snapshot_file for this snap is: volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33.e0ad79c5-3acb-489e-9bb1-1b7ef3d98379 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:20:41 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[d723a8a9-c0a8-49e0-bd32-50bb00f61b12]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b870bfaa-3b86-4552-8285-13bae9b7b798 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33.e0ad79c5-3acb-489e-9bb1-1b7ef3d98379 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:41 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:41 devstack sudo[106483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33.e0ad79c5-3acb-489e-9bb1-1b7ef3d98379
Sep 07 18:20:41 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2 1073741824" returned: 0 in 0.445s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:41 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:42 devstack sudo[106486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2
Sep 07 18:20:42 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:42 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b870bfaa-3b86-4552-8285-13bae9b7b798 tempest-ProjectReaderTests-554049164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33.e0ad79c5-3acb-489e-9bb1-1b7ef3d98379" returned: 0 in 0.382s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-b870bfaa-3b86-4552-8285-13bae9b7b798 tempest-ProjectReaderTests-554049164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:20:42 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95aeb59-b3ba-4056-9622-5ea692c0929d]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b870bfaa-3b86-4552-8285-13bae9b7b798 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:42 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2" returned: 0 in 0.273s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:42 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:20:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b999bec0-60e9-4d90-ad88-996c5c452f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c2a2986-429c-45fe-8b36-c459355fc1f2', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dac99fa-b4e4-420d-af9c-0e321d999f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:42 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Volume volume-1c2a2986-429c-45fe-8b36-c459355fc1f2 (1c2a2986-429c-45fe-8b36-c459355fc1f2): created successfully
Sep 07 18:20:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dac99fa-b4e4-420d-af9c-0e321d999f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:42 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Flow 'volume_create_manager' (207bf06f-2712-453b-8ea7-fed3a058526c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:42 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-784d050e-a6b6-48f6-a8b4-8dfb14f4df5f tempest-ProjectMemberTests-442300356 None] Created volume successfully.
Sep 07 18:20:42 devstack sudo[106492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33
Sep 07 18:20:42 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:42 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b870bfaa-3b86-4552-8285-13bae9b7b798 tempest-ProjectReaderTests-554049164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33" returned: 0 in 0.350s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b870bfaa-3b86-4552-8285-13bae9b7b798 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33.e0ad79c5-3acb-489e-9bb1-1b7ef3d98379 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:42 devstack sudo[106497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33.e0ad79c5-3acb-489e-9bb1-1b7ef3d98379
Sep 07 18:20:42 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:42 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b870bfaa-3b86-4552-8285-13bae9b7b798 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33.e0ad79c5-3acb-489e-9bb1-1b7ef3d98379" returned: 0 in 0.314s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:42 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b870bfaa-3b86-4552-8285-13bae9b7b798 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33.e0ad79c5-3acb-489e-9bb1-1b7ef3d98379 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:42 devstack sudo[106502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33.e0ad79c5-3acb-489e-9bb1-1b7ef3d98379
Sep 07 18:20:42 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:43 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b870bfaa-3b86-4552-8285-13bae9b7b798 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33.e0ad79c5-3acb-489e-9bb1-1b7ef3d98379" returned: 0 in 0.252s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b870bfaa-3b86-4552-8285-13bae9b7b798 tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-e0ad79c5-3acb-489e-9bb1-1b7ef3d98379" released by "_delete_snapshot" :: held 1.384s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b870bfaa-3b86-4552-8285-13bae9b7b798 tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-437ca458-9135-47bd-9ba9-f9b9f78e8a33" released by "delete_snapshot" :: held 1.408s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:43 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-b870bfaa-3b86-4552-8285-13bae9b7b798 tempest-ProjectReaderTests-554049164 None] Created reservations ['fcf0dfdf-9ec4-43a9-bbb8-bad5f0aad633', '07a6e838-b43e-4036-935a-9ed976301e16', '1d57db15-6fd2-42d0-acf8-7820e5260d9a', '25ead65a-f732-49ee-a15c-3157a4cda742'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:43 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b870bfaa-3b86-4552-8285-13bae9b7b798 tempest-ProjectReaderTests-554049164 None] Delete snapshot completed successfully.
Sep 07 18:20:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b870bfaa-3b86-4552-8285-13bae9b7b798 tempest-ProjectReaderTests-554049164 None] Lock "cinder-e0ad79c5-3acb-489e-9bb1-1b7ef3d98379-delete_snapshot" released by "delete_snapshot" :: held 1.584s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b9081b50-20d3-4008-8a12-7c28dd531f21 tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b9081b50-20d3-4008-8a12-7c28dd531f21 tempest-ProjectMemberTests-442300356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:43 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-b9081b50-20d3-4008-8a12-7c28dd531f21 tempest-ProjectMemberTests-442300356 None] Creating offline snapshot 2cb1b43c-d52b-41d0-994b-0d30e4eeede5 of volume 1c2a2986-429c-45fe-8b36-c459355fc1f2 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:20:43 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d58c504-ddda-4418-8355-034c643739ff]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b9081b50-20d3-4008-8a12-7c28dd531f21 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:43 devstack sudo[106505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2
Sep 07 18:20:43 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:43 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b9081b50-20d3-4008-8a12-7c28dd531f21 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2" returned: 0 in 0.358s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:43 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b9081b50-20d3-4008-8a12-7c28dd531f21 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2.2cb1b43c-d52b-41d0-994b-0d30e4eeede5 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8e9d60e3-9273-417f-9def-080dacc99ae6 tempest-ProjectReaderTests-554049164 None] Acquiring lock "cinder-437ca458-9135-47bd-9ba9-f9b9f78e8a33-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:43 devstack sudo[106510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2.2cb1b43c-d52b-41d0-994b-0d30e4eeede5 1G
Sep 07 18:20:43 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8e9d60e3-9273-417f-9def-080dacc99ae6 tempest-ProjectReaderTests-554049164 None] Lock "cinder-437ca458-9135-47bd-9ba9-f9b9f78e8a33-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8e9d60e3-9273-417f-9def-080dacc99ae6 tempest-ProjectReaderTests-554049164 None] Acquiring lock "cinder-quobyte-437ca458-9135-47bd-9ba9-f9b9f78e8a33" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:43 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8e9d60e3-9273-417f-9def-080dacc99ae6 tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-437ca458-9135-47bd-9ba9-f9b9f78e8a33" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:44 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b5f0bf-3315-4a5e-818d-338143d187cd]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8e9d60e3-9273-417f-9def-080dacc99ae6 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:44 devstack sudo[106512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33
Sep 07 18:20:44 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:44 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b9081b50-20d3-4008-8a12-7c28dd531f21 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2.2cb1b43c-d52b-41d0-994b-0d30e4eeede5 1G" returned: 0 in 0.401s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b9081b50-20d3-4008-8a12-7c28dd531f21 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c2a2986-429c-45fe-8b36-c459355fc1f2 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2.2cb1b43c-d52b-41d0-994b-0d30e4eeede5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:44 devstack sudo[106517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c2a2986-429c-45fe-8b36-c459355fc1f2 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2.2cb1b43c-d52b-41d0-994b-0d30e4eeede5
Sep 07 18:20:44 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:44 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8e9d60e3-9273-417f-9def-080dacc99ae6 tempest-ProjectReaderTests-554049164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33" returned: 0 in 0.360s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8e9d60e3-9273-417f-9def-080dacc99ae6 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:44 devstack sudo[106522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33
Sep 07 18:20:44 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:44 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b9081b50-20d3-4008-8a12-7c28dd531f21 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c2a2986-429c-45fe-8b36-c459355fc1f2 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2.2cb1b43c-d52b-41d0-994b-0d30e4eeede5" returned: 0 in 0.301s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:44 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-b9081b50-20d3-4008-8a12-7c28dd531f21 tempest-ProjectMemberTests-442300356 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2.2cb1b43c-d52b-41d0-994b-0d30e4eeede5 is being set with open permissions: ugo+rw
Sep 07 18:20:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b9081b50-20d3-4008-8a12-7c28dd531f21 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2.2cb1b43c-d52b-41d0-994b-0d30e4eeede5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:44 devstack sudo[106527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2.2cb1b43c-d52b-41d0-994b-0d30e4eeede5
Sep 07 18:20:44 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:44 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8e9d60e3-9273-417f-9def-080dacc99ae6 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-437ca458-9135-47bd-9ba9-f9b9f78e8a33" returned: 0 in 0.252s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:44 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8e9d60e3-9273-417f-9def-080dacc99ae6 tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-437ca458-9135-47bd-9ba9-f9b9f78e8a33" released by "delete_volume" :: held 0.666s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:44 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-8e9d60e3-9273-417f-9def-080dacc99ae6 tempest-ProjectReaderTests-554049164 None] Created reservations ['a606eb69-780c-4bb2-881e-be0473251ef7', 'bf7eb22c-9f03-4697-8432-3f10ecaa17f2', '2ee3d7e1-7553-424e-a323-637e534fcc81', '33d867b5-2a09-4e6e-9a9b-c7b4267395df'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8e9d60e3-9273-417f-9def-080dacc99ae6 tempest-ProjectReaderTests-554049164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8e9d60e3-9273-417f-9def-080dacc99ae6 tempest-ProjectReaderTests-554049164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8e9d60e3-9273-417f-9def-080dacc99ae6 tempest-ProjectReaderTests-554049164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:44 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8e9d60e3-9273-417f-9def-080dacc99ae6 tempest-ProjectReaderTests-554049164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8e9d60e3-9273-417f-9def-080dacc99ae6 tempest-ProjectReaderTests-554049164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8e9d60e3-9273-417f-9def-080dacc99ae6 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:44 devstack sudo[106530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:20:44 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:44 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b9081b50-20d3-4008-8a12-7c28dd531f21 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2.2cb1b43c-d52b-41d0-994b-0d30e4eeede5" returned: 0 in 0.257s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:44 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b9081b50-20d3-4008-8a12-7c28dd531f21 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:44 devstack sudo[106533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2.info
Sep 07 18:20:44 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:45 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8e9d60e3-9273-417f-9def-080dacc99ae6 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.268s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-8e9d60e3-9273-417f-9def-080dacc99ae6 tempest-ProjectReaderTests-554049164 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:20:45 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-8e9d60e3-9273-417f-9def-080dacc99ae6 tempest-ProjectReaderTests-554049164 None] Deleted volume successfully.
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8e9d60e3-9273-417f-9def-080dacc99ae6 tempest-ProjectReaderTests-554049164 None] Lock "cinder-437ca458-9135-47bd-9ba9-f9b9f78e8a33-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:45 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b9081b50-20d3-4008-8a12-7c28dd531f21 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2.info" returned: 0 in 0.271s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:45 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-b9081b50-20d3-4008-8a12-7c28dd531f21 tempest-ProjectMemberTests-442300356 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2.info is being set with open permissions: ugo+rw
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b9081b50-20d3-4008-8a12-7c28dd531f21 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:45 devstack sudo[106537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2.info
Sep 07 18:20:45 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:45 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b9081b50-20d3-4008-8a12-7c28dd531f21 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2.info" returned: 0 in 0.264s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b9081b50-20d3-4008-8a12-7c28dd531f21 tempest-ProjectMemberTests-442300356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.930s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:45 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b9081b50-20d3-4008-8a12-7c28dd531f21 tempest-ProjectMemberTests-442300356 None] Create snapshot completed successfully
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Flow 'volume_create_manager' (d874764d-f803-4fb5-99e9-2e4bf8b3040f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b92d6e7-96c5-49bd-ba49-e69b23edba7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b92d6e7-96c5-49bd-ba49-e69b23edba7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1279677325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b1ec257-83cc-4f7d-ab05-4624477491b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122955d74f7a41f483601df502229750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:45Z,use_quota=True,user_id='91f34d73a70e42a797d7d3ec9310ed72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6e43e2-8dd5-4544-8c9b-e507fa6d4794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d6e43e2-8dd5-4544-8c9b-e507fa6d4794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3113ce50-ef5a-441d-a513-1ca44e3bb16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3113ce50-ef5a-441d-a513-1ca44e3bb16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b1ec257-83cc-4f7d-ab05-4624477491b1', 'volume_name': 'volume-9b1ec257-83cc-4f7d-ab05-4624477491b1', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d93f98-c22a-4536-8475-587c8962a9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d93f98-c22a-4536-8475-587c8962a9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1785057e-33dd-43b6-a052-a457ea6af99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:45 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Volume 9b1ec257-83cc-4f7d-ab05-4624477491b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b1ec257-83cc-4f7d-ab05-4624477491b1', 'volume_size': 1}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1279677325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b1ec257-83cc-4f7d-ab05-4624477491b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122955d74f7a41f483601df502229750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:45Z,use_quota=True,user_id='91f34d73a70e42a797d7d3ec9310ed72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Creating volume 9b1ec257-83cc-4f7d-ab05-4624477491b1 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:20:45 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ac82870f-9fbb-4ac3-8cd2-f1e0256b6758 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-2cb1b43c-d52b-41d0-994b-0d30e4eeede5-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:45 devstack sudo[106540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1 1073741824
Sep 07 18:20:45 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ac82870f-9fbb-4ac3-8cd2-f1e0256b6758 tempest-ProjectMemberTests-442300356 None] Lock "cinder-2cb1b43c-d52b-41d0-994b-0d30e4eeede5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ac82870f-9fbb-4ac3-8cd2-f1e0256b6758 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-quobyte-1c2a2986-429c-45fe-8b36-c459355fc1f2" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ac82870f-9fbb-4ac3-8cd2-f1e0256b6758 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-1c2a2986-429c-45fe-8b36-c459355fc1f2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ac82870f-9fbb-4ac3-8cd2-f1e0256b6758 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-quobyte-2cb1b43c-d52b-41d0-994b-0d30e4eeede5" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ac82870f-9fbb-4ac3-8cd2-f1e0256b6758 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-2cb1b43c-d52b-41d0-994b-0d30e4eeede5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ac82870f-9fbb-4ac3-8cd2-f1e0256b6758 tempest-ProjectMemberTests-442300356 None] Deleting offline snapshot 2cb1b43c-d52b-41d0-994b-0d30e4eeede5 of volume 1c2a2986-429c-45fe-8b36-c459355fc1f2 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ac82870f-9fbb-4ac3-8cd2-f1e0256b6758 tempest-ProjectMemberTests-442300356 None] snapshot_file for this snap is: volume-1c2a2986-429c-45fe-8b36-c459355fc1f2.2cb1b43c-d52b-41d0-994b-0d30e4eeede5 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d156d0-3bce-4ef1-b024-b4349e962ac9]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:45 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac82870f-9fbb-4ac3-8cd2-f1e0256b6758 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2.2cb1b43c-d52b-41d0-994b-0d30e4eeede5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:45 devstack sudo[106542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2.2cb1b43c-d52b-41d0-994b-0d30e4eeede5
Sep 07 18:20:45 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:46 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1 1073741824" returned: 0 in 0.436s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:46 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac82870f-9fbb-4ac3-8cd2-f1e0256b6758 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2.2cb1b43c-d52b-41d0-994b-0d30e4eeede5" returned: 0 in 0.358s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-ac82870f-9fbb-4ac3-8cd2-f1e0256b6758 tempest-ProjectMemberTests-442300356 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c2a2986-429c-45fe-8b36-c459355fc1f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:20:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:46 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[80521076-b6bf-4677-91c5-2277fb939ff0]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac82870f-9fbb-4ac3-8cd2-f1e0256b6758 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:46 devstack sudo[106550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1
Sep 07 18:20:46 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:46 devstack sudo[106551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2
Sep 07 18:20:46 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:46 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1" returned: 0 in 0.237s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:20:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1785057e-33dd-43b6-a052-a457ea6af99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b1ec257-83cc-4f7d-ab05-4624477491b1', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ed8049-b661-44f9-bf5e-b4006e2220d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:46 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Volume volume-9b1ec257-83cc-4f7d-ab05-4624477491b1 (9b1ec257-83cc-4f7d-ab05-4624477491b1): created successfully
Sep 07 18:20:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21ed8049-b661-44f9-bf5e-b4006e2220d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:46 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Flow 'volume_create_manager' (d874764d-f803-4fb5-99e9-2e4bf8b3040f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:46 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-91346990-fb44-4f29-ae06-e38c2558bdbf tempest-ProjectReaderTests-554049164 None] Created volume successfully.
Sep 07 18:20:46 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac82870f-9fbb-4ac3-8cd2-f1e0256b6758 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2" returned: 0 in 0.360s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac82870f-9fbb-4ac3-8cd2-f1e0256b6758 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2.2cb1b43c-d52b-41d0-994b-0d30e4eeede5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:46 devstack sudo[106558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2.2cb1b43c-d52b-41d0-994b-0d30e4eeede5
Sep 07 18:20:46 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-159e8b4f-e483-4882-96a9-960e3f5d4df9 tempest-ProjectReaderTests-554049164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-159e8b4f-e483-4882-96a9-960e3f5d4df9 tempest-ProjectReaderTests-554049164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:46 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-159e8b4f-e483-4882-96a9-960e3f5d4df9 tempest-ProjectReaderTests-554049164 None] Creating offline snapshot 54a1cc4d-d451-4b92-bee5-14b3a216e7d5 of volume 9b1ec257-83cc-4f7d-ab05-4624477491b1 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:20:46 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13d8d25-1fc3-4546-9f79-639b02fdd30d]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-159e8b4f-e483-4882-96a9-960e3f5d4df9 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:46 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac82870f-9fbb-4ac3-8cd2-f1e0256b6758 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2.2cb1b43c-d52b-41d0-994b-0d30e4eeede5" returned: 0 in 0.369s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:46 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac82870f-9fbb-4ac3-8cd2-f1e0256b6758 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2.2cb1b43c-d52b-41d0-994b-0d30e4eeede5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:46 devstack sudo[106563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1
Sep 07 18:20:46 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:46 devstack sudo[106566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2.2cb1b43c-d52b-41d0-994b-0d30e4eeede5
Sep 07 18:20:46 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:47 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:47 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-ac82870f-9fbb-4ac3-8cd2-f1e0256b6758 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2.2cb1b43c-d52b-41d0-994b-0d30e4eeede5" returned: 0 in 0.258s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-159e8b4f-e483-4882-96a9-960e3f5d4df9 tempest-ProjectReaderTests-554049164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1" returned: 0 in 0.396s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-159e8b4f-e483-4882-96a9-960e3f5d4df9 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1.54a1cc4d-d451-4b92-bee5-14b3a216e7d5 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ac82870f-9fbb-4ac3-8cd2-f1e0256b6758 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-2cb1b43c-d52b-41d0-994b-0d30e4eeede5" released by "_delete_snapshot" :: held 1.441s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ac82870f-9fbb-4ac3-8cd2-f1e0256b6758 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-1c2a2986-429c-45fe-8b36-c459355fc1f2" released by "delete_snapshot" :: held 1.465s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:47 devstack sudo[106572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1.54a1cc4d-d451-4b92-bee5-14b3a216e7d5 1G
Sep 07 18:20:47 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:47 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-ac82870f-9fbb-4ac3-8cd2-f1e0256b6758 tempest-ProjectMemberTests-442300356 None] Created reservations ['ed6f4f5d-6a7a-4c33-8bd1-828b107b6196', '6c20e050-f61f-40b1-990d-687841b79d1e', '74e3f765-689b-4340-a1c2-1d032324aba9', '70f68285-b869-4053-86a0-a66d4788cf0a'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:47 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-ac82870f-9fbb-4ac3-8cd2-f1e0256b6758 tempest-ProjectMemberTests-442300356 None] Delete snapshot completed successfully.
Sep 07 18:20:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-ac82870f-9fbb-4ac3-8cd2-f1e0256b6758 tempest-ProjectMemberTests-442300356 None] Lock "cinder-2cb1b43c-d52b-41d0-994b-0d30e4eeede5-delete_snapshot" released by "delete_snapshot" :: held 1.616s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:47 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-159e8b4f-e483-4882-96a9-960e3f5d4df9 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1.54a1cc4d-d451-4b92-bee5-14b3a216e7d5 1G" returned: 0 in 0.392s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-159e8b4f-e483-4882-96a9-960e3f5d4df9 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b1ec257-83cc-4f7d-ab05-4624477491b1 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1.54a1cc4d-d451-4b92-bee5-14b3a216e7d5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:47 devstack sudo[106577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b1ec257-83cc-4f7d-ab05-4624477491b1 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1.54a1cc4d-d451-4b92-bee5-14b3a216e7d5
Sep 07 18:20:47 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:47 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-745104f9-dd0a-4505-8f91-8afddc84545b tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-1c2a2986-429c-45fe-8b36-c459355fc1f2-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-159e8b4f-e483-4882-96a9-960e3f5d4df9 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b1ec257-83cc-4f7d-ab05-4624477491b1 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1.54a1cc4d-d451-4b92-bee5-14b3a216e7d5" returned: 0 in 0.294s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:47 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-159e8b4f-e483-4882-96a9-960e3f5d4df9 tempest-ProjectReaderTests-554049164 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1.54a1cc4d-d451-4b92-bee5-14b3a216e7d5 is being set with open permissions: ugo+rw
Sep 07 18:20:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-159e8b4f-e483-4882-96a9-960e3f5d4df9 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1.54a1cc4d-d451-4b92-bee5-14b3a216e7d5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-745104f9-dd0a-4505-8f91-8afddc84545b tempest-ProjectMemberTests-442300356 None] Lock "cinder-1c2a2986-429c-45fe-8b36-c459355fc1f2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:47 devstack sudo[106582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1.54a1cc4d-d451-4b92-bee5-14b3a216e7d5
Sep 07 18:20:47 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-745104f9-dd0a-4505-8f91-8afddc84545b tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-quobyte-1c2a2986-429c-45fe-8b36-c459355fc1f2" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:47 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-745104f9-dd0a-4505-8f91-8afddc84545b tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-1c2a2986-429c-45fe-8b36-c459355fc1f2" acquired by "delete_volume" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:47 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[0148d76b-8f9e-4148-9120-f5302a0e0409]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:47 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-745104f9-dd0a-4505-8f91-8afddc84545b tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:48 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-159e8b4f-e483-4882-96a9-960e3f5d4df9 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1.54a1cc4d-d451-4b92-bee5-14b3a216e7d5" returned: 0 in 0.253s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-159e8b4f-e483-4882-96a9-960e3f5d4df9 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:48 devstack sudo[106584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2
Sep 07 18:20:48 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:48 devstack sudo[106587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1.info
Sep 07 18:20:48 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:48 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-745104f9-dd0a-4505-8f91-8afddc84545b tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2" returned: 0 in 0.359s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-745104f9-dd0a-4505-8f91-8afddc84545b tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:48 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-159e8b4f-e483-4882-96a9-960e3f5d4df9 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1.info" returned: 0 in 0.262s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:48 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-159e8b4f-e483-4882-96a9-960e3f5d4df9 tempest-ProjectReaderTests-554049164 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1.info is being set with open permissions: ugo+rw
Sep 07 18:20:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-159e8b4f-e483-4882-96a9-960e3f5d4df9 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:48 devstack sudo[106593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2
Sep 07 18:20:48 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:48 devstack sudo[106594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1.info
Sep 07 18:20:48 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:48 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-159e8b4f-e483-4882-96a9-960e3f5d4df9 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1.info" returned: 0 in 0.242s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:48 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-159e8b4f-e483-4882-96a9-960e3f5d4df9 tempest-ProjectReaderTests-554049164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.927s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-745104f9-dd0a-4505-8f91-8afddc84545b tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1c2a2986-429c-45fe-8b36-c459355fc1f2" returned: 0 in 0.278s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-745104f9-dd0a-4505-8f91-8afddc84545b tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-1c2a2986-429c-45fe-8b36-c459355fc1f2" released by "delete_volume" :: held 0.705s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:48 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-159e8b4f-e483-4882-96a9-960e3f5d4df9 tempest-ProjectReaderTests-554049164 None] Create snapshot completed successfully
Sep 07 18:20:48 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-745104f9-dd0a-4505-8f91-8afddc84545b tempest-ProjectMemberTests-442300356 None] Created reservations ['1a2a6b0e-a7c3-4c99-ba2d-9b4feba55c3f', '1eaf926e-9918-4261-b3ae-6e2801e11d47', 'd454947d-e9f0-48fa-8d3d-9fce3244184d', '0b8ae236-6f08-4e38-8a32-683e815f3a55'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-745104f9-dd0a-4505-8f91-8afddc84545b tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-745104f9-dd0a-4505-8f91-8afddc84545b tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-745104f9-dd0a-4505-8f91-8afddc84545b tempest-ProjectMemberTests-442300356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-745104f9-dd0a-4505-8f91-8afddc84545b tempest-ProjectMemberTests-442300356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-745104f9-dd0a-4505-8f91-8afddc84545b tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-745104f9-dd0a-4505-8f91-8afddc84545b tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-18aa824a-47e1-47b5-8c42-93cc5c5e9fe7 tempest-ProjectReaderTests-554049164 None] Acquiring lock "cinder-54a1cc4d-d451-4b92-bee5-14b3a216e7d5-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:48 devstack sudo[106599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:20:48 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-18aa824a-47e1-47b5-8c42-93cc5c5e9fe7 tempest-ProjectReaderTests-554049164 None] Lock "cinder-54a1cc4d-d451-4b92-bee5-14b3a216e7d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-18aa824a-47e1-47b5-8c42-93cc5c5e9fe7 tempest-ProjectReaderTests-554049164 None] Acquiring lock "cinder-quobyte-9b1ec257-83cc-4f7d-ab05-4624477491b1" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-18aa824a-47e1-47b5-8c42-93cc5c5e9fe7 tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-9b1ec257-83cc-4f7d-ab05-4624477491b1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-18aa824a-47e1-47b5-8c42-93cc5c5e9fe7 tempest-ProjectReaderTests-554049164 None] Acquiring lock "cinder-quobyte-54a1cc4d-d451-4b92-bee5-14b3a216e7d5" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:48 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-18aa824a-47e1-47b5-8c42-93cc5c5e9fe7 tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-54a1cc4d-d451-4b92-bee5-14b3a216e7d5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-18aa824a-47e1-47b5-8c42-93cc5c5e9fe7 tempest-ProjectReaderTests-554049164 None] Deleting offline snapshot 54a1cc4d-d451-4b92-bee5-14b3a216e7d5 of volume 9b1ec257-83cc-4f7d-ab05-4624477491b1 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:20:48 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-18aa824a-47e1-47b5-8c42-93cc5c5e9fe7 tempest-ProjectReaderTests-554049164 None] snapshot_file for this snap is: volume-9b1ec257-83cc-4f7d-ab05-4624477491b1.54a1cc4d-d451-4b92-bee5-14b3a216e7d5 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:20:48 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6015b2-6bf4-428a-ab69-83798ffcc1f6]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:48 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-18aa824a-47e1-47b5-8c42-93cc5c5e9fe7 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1.54a1cc4d-d451-4b92-bee5-14b3a216e7d5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:48 devstack sudo[106601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1.54a1cc4d-d451-4b92-bee5-14b3a216e7d5
Sep 07 18:20:49 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:49 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-745104f9-dd0a-4505-8f91-8afddc84545b tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.272s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-745104f9-dd0a-4505-8f91-8afddc84545b tempest-ProjectMemberTests-442300356 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:20:49 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-745104f9-dd0a-4505-8f91-8afddc84545b tempest-ProjectMemberTests-442300356 None] Deleted volume successfully.
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-745104f9-dd0a-4505-8f91-8afddc84545b tempest-ProjectMemberTests-442300356 None] Lock "cinder-1c2a2986-429c-45fe-8b36-c459355fc1f2-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:49 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-18aa824a-47e1-47b5-8c42-93cc5c5e9fe7 tempest-ProjectReaderTests-554049164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1.54a1cc4d-d451-4b92-bee5-14b3a216e7d5" returned: 0 in 0.425s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-18aa824a-47e1-47b5-8c42-93cc5c5e9fe7 tempest-ProjectReaderTests-554049164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b1ec257-83cc-4f7d-ab05-4624477491b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[428a297b-37b3-4af6-b6b6-979bc36d1189]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-18aa824a-47e1-47b5-8c42-93cc5c5e9fe7 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:20:49 devstack sudo[106607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1
Sep 07 18:20:49 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Flow 'volume_create_manager' (ed2b0374-c29f-4502-87d2-127e1d245b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b796f1a3-0b26-4ea2-be73-6b5d833c9aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b796f1a3-0b26-4ea2-be73-6b5d833c9aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2022233858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd48625b-655b-4515-b08a-f5ccc03da22c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e449daccfbab4cd8ba38df886cea84bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:49Z,use_quota=True,user_id='d0204c187bcf4a5ba9582bac88f452df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17e020c-d2a8-49d2-8ba0-f7be9eb321a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d17e020c-d2a8-49d2-8ba0-f7be9eb321a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83cdb1ea-ceda-41eb-9947-a2143662f788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83cdb1ea-ceda-41eb-9947-a2143662f788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd48625b-655b-4515-b08a-f5ccc03da22c', 'volume_name': 'volume-bd48625b-655b-4515-b08a-f5ccc03da22c', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd0ac51-ca5e-4df7-a951-ca05539f1b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd0ac51-ca5e-4df7-a951-ca05539f1b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab143108-cf0e-43f0-a0f6-12add5d0a29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:49 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Volume bd48625b-655b-4515-b08a-f5ccc03da22c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd48625b-655b-4515-b08a-f5ccc03da22c', 'volume_size': 1}
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2022233858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd48625b-655b-4515-b08a-f5ccc03da22c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e449daccfbab4cd8ba38df886cea84bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:49Z,use_quota=True,user_id='d0204c187bcf4a5ba9582bac88f452df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Creating volume bd48625b-655b-4515-b08a-f5ccc03da22c {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:20:49 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:49 devstack sudo[106609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c 1073741824
Sep 07 18:20:49 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:49 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-18aa824a-47e1-47b5-8c42-93cc5c5e9fe7 tempest-ProjectReaderTests-554049164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1" returned: 0 in 0.351s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-18aa824a-47e1-47b5-8c42-93cc5c5e9fe7 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1.54a1cc4d-d451-4b92-bee5-14b3a216e7d5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:49 devstack sudo[106614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1.54a1cc4d-d451-4b92-bee5-14b3a216e7d5
Sep 07 18:20:49 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:49 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c 1073741824" returned: 0 in 0.419s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:49 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:50 devstack sudo[106622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c
Sep 07 18:20:50 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:50 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-18aa824a-47e1-47b5-8c42-93cc5c5e9fe7 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1.54a1cc4d-d451-4b92-bee5-14b3a216e7d5" returned: 0 in 0.384s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-18aa824a-47e1-47b5-8c42-93cc5c5e9fe7 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1.54a1cc4d-d451-4b92-bee5-14b3a216e7d5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:50 devstack sudo[106625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1.54a1cc4d-d451-4b92-bee5-14b3a216e7d5
Sep 07 18:20:50 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:50 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c" returned: 0 in 0.256s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:20:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab143108-cf0e-43f0-a0f6-12add5d0a29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd48625b-655b-4515-b08a-f5ccc03da22c', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae82e718-8fa8-4537-917b-8fb4abc42143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:50 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Volume volume-bd48625b-655b-4515-b08a-f5ccc03da22c (bd48625b-655b-4515-b08a-f5ccc03da22c): created successfully
Sep 07 18:20:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae82e718-8fa8-4537-917b-8fb4abc42143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:50 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Flow 'volume_create_manager' (ed2b0374-c29f-4502-87d2-127e1d245b66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:50 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3be8a83e-cf8e-497d-bdbb-8a42f052a22b tempest-ProjectMemberTests-442300356 None] Created volume successfully.
Sep 07 18:20:50 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-18aa824a-47e1-47b5-8c42-93cc5c5e9fe7 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1.54a1cc4d-d451-4b92-bee5-14b3a216e7d5" returned: 0 in 0.248s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-18aa824a-47e1-47b5-8c42-93cc5c5e9fe7 tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-54a1cc4d-d451-4b92-bee5-14b3a216e7d5" released by "_delete_snapshot" :: held 1.503s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-18aa824a-47e1-47b5-8c42-93cc5c5e9fe7 tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-9b1ec257-83cc-4f7d-ab05-4624477491b1" released by "delete_snapshot" :: held 1.526s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:50 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-18aa824a-47e1-47b5-8c42-93cc5c5e9fe7 tempest-ProjectReaderTests-554049164 None] Created reservations ['c4d74777-f315-4910-8f8b-0ce70542278b', 'fab5aa55-97a2-4bdd-b7da-816314215d70', '91413709-faa9-496e-a951-6a548f199080', 'fac07834-5c1d-4b79-bebb-23d602289f0f'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:50 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-18aa824a-47e1-47b5-8c42-93cc5c5e9fe7 tempest-ProjectReaderTests-554049164 None] Delete snapshot completed successfully.
Sep 07 18:20:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-18aa824a-47e1-47b5-8c42-93cc5c5e9fe7 tempest-ProjectReaderTests-554049164 None] Lock "cinder-54a1cc4d-d451-4b92-bee5-14b3a216e7d5-delete_snapshot" released by "delete_snapshot" :: held 1.678s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f46df62e-4c66-40d8-8131-ab1e62ee52ce tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f46df62e-4c66-40d8-8131-ab1e62ee52ce tempest-ProjectMemberTests-442300356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:50 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-f46df62e-4c66-40d8-8131-ab1e62ee52ce tempest-ProjectMemberTests-442300356 None] Creating offline snapshot 17d1fb60-d152-42a6-8f09-8ba0feb83f7e of volume bd48625b-655b-4515-b08a-f5ccc03da22c {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:20:50 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[580cab48-1cfb-4c49-92f0-3f6b7f7caf4e]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:50 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f46df62e-4c66-40d8-8131-ab1e62ee52ce tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:50 devstack sudo[106629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c
Sep 07 18:20:50 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-75c9e1a7-eaa7-4e06-b3a8-19b4b8404ab8 tempest-ProjectReaderTests-554049164 None] Acquiring lock "cinder-9b1ec257-83cc-4f7d-ab05-4624477491b1-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:50 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-75c9e1a7-eaa7-4e06-b3a8-19b4b8404ab8 tempest-ProjectReaderTests-554049164 None] Lock "cinder-9b1ec257-83cc-4f7d-ab05-4624477491b1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:50 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=217,cinder:INSERT=80,cinder:UPDATE=275,cinder:DELETE=18 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:20:51 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:UPDATE=288,cinder:DELETE=30,cinder:SELECT=212,cinder:INSERT=69 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:20:51 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f46df62e-4c66-40d8-8131-ab1e62ee52ce tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c" returned: 0 in 0.381s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f46df62e-4c66-40d8-8131-ab1e62ee52ce tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c.17d1fb60-d152-42a6-8f09-8ba0feb83f7e 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-75c9e1a7-eaa7-4e06-b3a8-19b4b8404ab8 tempest-ProjectReaderTests-554049164 None] Acquiring lock "cinder-quobyte-9b1ec257-83cc-4f7d-ab05-4624477491b1" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:51 devstack sudo[106634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c.17d1fb60-d152-42a6-8f09-8ba0feb83f7e 1G
Sep 07 18:20:51 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-75c9e1a7-eaa7-4e06-b3a8-19b4b8404ab8 tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-9b1ec257-83cc-4f7d-ab05-4624477491b1" acquired by "delete_volume" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:51 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9e0079-efe6-421c-8cb7-3449a0797ecd]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-75c9e1a7-eaa7-4e06-b3a8-19b4b8404ab8 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:51 devstack sudo[106636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1
Sep 07 18:20:51 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:51 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f46df62e-4c66-40d8-8131-ab1e62ee52ce tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c.17d1fb60-d152-42a6-8f09-8ba0feb83f7e 1G" returned: 0 in 0.395s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f46df62e-4c66-40d8-8131-ab1e62ee52ce tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd48625b-655b-4515-b08a-f5ccc03da22c -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c.17d1fb60-d152-42a6-8f09-8ba0feb83f7e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:51 devstack sudo[106644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd48625b-655b-4515-b08a-f5ccc03da22c -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c.17d1fb60-d152-42a6-8f09-8ba0feb83f7e
Sep 07 18:20:51 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:51 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-75c9e1a7-eaa7-4e06-b3a8-19b4b8404ab8 tempest-ProjectReaderTests-554049164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1" returned: 0 in 0.367s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-75c9e1a7-eaa7-4e06-b3a8-19b4b8404ab8 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:51 devstack sudo[106647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1
Sep 07 18:20:51 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:51 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f46df62e-4c66-40d8-8131-ab1e62ee52ce tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd48625b-655b-4515-b08a-f5ccc03da22c -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c.17d1fb60-d152-42a6-8f09-8ba0feb83f7e" returned: 0 in 0.290s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:51 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-f46df62e-4c66-40d8-8131-ab1e62ee52ce tempest-ProjectMemberTests-442300356 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c.17d1fb60-d152-42a6-8f09-8ba0feb83f7e is being set with open permissions: ugo+rw
Sep 07 18:20:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f46df62e-4c66-40d8-8131-ab1e62ee52ce tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c.17d1fb60-d152-42a6-8f09-8ba0feb83f7e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:51 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:51 devstack sudo[106653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c.17d1fb60-d152-42a6-8f09-8ba0feb83f7e
Sep 07 18:20:51 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-75c9e1a7-eaa7-4e06-b3a8-19b4b8404ab8 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-9b1ec257-83cc-4f7d-ab05-4624477491b1" returned: 0 in 0.251s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:51 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-75c9e1a7-eaa7-4e06-b3a8-19b4b8404ab8 tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-9b1ec257-83cc-4f7d-ab05-4624477491b1" released by "delete_volume" :: held 0.680s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:51 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-75c9e1a7-eaa7-4e06-b3a8-19b4b8404ab8 tempest-ProjectReaderTests-554049164 None] Created reservations ['4627203a-1f62-4c84-822e-58d80f761d94', '861b4d0a-0e53-4f99-bf27-95ab8f861a2b', 'd6aa0851-bd5c-4d35-86a9-b071a9ecec8d', 'b4a1747b-dfc3-48af-b697-e5439713c776'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-75c9e1a7-eaa7-4e06-b3a8-19b4b8404ab8 tempest-ProjectReaderTests-554049164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-75c9e1a7-eaa7-4e06-b3a8-19b4b8404ab8 tempest-ProjectReaderTests-554049164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-75c9e1a7-eaa7-4e06-b3a8-19b4b8404ab8 tempest-ProjectReaderTests-554049164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:51 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-75c9e1a7-eaa7-4e06-b3a8-19b4b8404ab8 tempest-ProjectReaderTests-554049164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-75c9e1a7-eaa7-4e06-b3a8-19b4b8404ab8 tempest-ProjectReaderTests-554049164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-75c9e1a7-eaa7-4e06-b3a8-19b4b8404ab8 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:51 devstack sudo[106655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:20:51 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:51 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f46df62e-4c66-40d8-8131-ab1e62ee52ce tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c.17d1fb60-d152-42a6-8f09-8ba0feb83f7e" returned: 0 in 0.247s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:51 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f46df62e-4c66-40d8-8131-ab1e62ee52ce tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:52 devstack sudo[106658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c.info
Sep 07 18:20:52 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:52 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-75c9e1a7-eaa7-4e06-b3a8-19b4b8404ab8 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.273s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-75c9e1a7-eaa7-4e06-b3a8-19b4b8404ab8 tempest-ProjectReaderTests-554049164 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:20:52 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-75c9e1a7-eaa7-4e06-b3a8-19b4b8404ab8 tempest-ProjectReaderTests-554049164 None] Deleted volume successfully.
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-75c9e1a7-eaa7-4e06-b3a8-19b4b8404ab8 tempest-ProjectReaderTests-554049164 None] Lock "cinder-9b1ec257-83cc-4f7d-ab05-4624477491b1-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:52 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f46df62e-4c66-40d8-8131-ab1e62ee52ce tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c.info" returned: 0 in 0.254s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:52 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-f46df62e-4c66-40d8-8131-ab1e62ee52ce tempest-ProjectMemberTests-442300356 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c.info is being set with open permissions: ugo+rw
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f46df62e-4c66-40d8-8131-ab1e62ee52ce tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:52 devstack sudo[106662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c.info
Sep 07 18:20:52 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:52 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f46df62e-4c66-40d8-8131-ab1e62ee52ce tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c.info" returned: 0 in 0.260s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f46df62e-4c66-40d8-8131-ab1e62ee52ce tempest-ProjectMemberTests-442300356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.905s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:52 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f46df62e-4c66-40d8-8131-ab1e62ee52ce tempest-ProjectMemberTests-442300356 None] Create snapshot completed successfully
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Flow 'volume_create_manager' (f27e505b-61d6-4bc7-9c8a-890fe75cce43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28525c0d-93c2-4f13-ad4d-f4e3de4ce90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28525c0d-93c2-4f13-ad4d-f4e3de4ce90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-134371975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de199448-c3c1-48e1-a927-155438fd6ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122955d74f7a41f483601df502229750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:53Z,use_quota=True,user_id='91f34d73a70e42a797d7d3ec9310ed72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a4d1bd6-57d9-4223-a914-e0382a28d7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a4d1bd6-57d9-4223-a914-e0382a28d7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (883ad7dc-5f0a-4272-ac0a-7644c9ddf565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (883ad7dc-5f0a-4272-ac0a-7644c9ddf565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de199448-c3c1-48e1-a927-155438fd6ea5', 'volume_name': 'volume-de199448-c3c1-48e1-a927-155438fd6ea5', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d790aa1b-7a37-4847-8d91-cf40cc62da21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d790aa1b-7a37-4847-8d91-cf40cc62da21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a53c2e-2207-468e-b1d6-8bcbcd9d6dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:52 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Volume de199448-c3c1-48e1-a927-155438fd6ea5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de199448-c3c1-48e1-a927-155438fd6ea5', 'volume_size': 1}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-134371975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de199448-c3c1-48e1-a927-155438fd6ea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122955d74f7a41f483601df502229750',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:53Z,use_quota=True,user_id='91f34d73a70e42a797d7d3ec9310ed72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Creating volume de199448-c3c1-48e1-a927-155438fd6ea5 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:20:52 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:52 devstack sudo[106665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5 1073741824
Sep 07 18:20:52 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f65d7d2-31d5-49bb-8195-e93da0ca98af tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-17d1fb60-d152-42a6-8f09-8ba0feb83f7e-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f65d7d2-31d5-49bb-8195-e93da0ca98af tempest-ProjectMemberTests-442300356 None] Lock "cinder-17d1fb60-d152-42a6-8f09-8ba0feb83f7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f65d7d2-31d5-49bb-8195-e93da0ca98af tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-quobyte-bd48625b-655b-4515-b08a-f5ccc03da22c" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f65d7d2-31d5-49bb-8195-e93da0ca98af tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-bd48625b-655b-4515-b08a-f5ccc03da22c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f65d7d2-31d5-49bb-8195-e93da0ca98af tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-quobyte-17d1fb60-d152-42a6-8f09-8ba0feb83f7e" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f65d7d2-31d5-49bb-8195-e93da0ca98af tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-17d1fb60-d152-42a6-8f09-8ba0feb83f7e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-3f65d7d2-31d5-49bb-8195-e93da0ca98af tempest-ProjectMemberTests-442300356 None] Deleting offline snapshot 17d1fb60-d152-42a6-8f09-8ba0feb83f7e of volume bd48625b-655b-4515-b08a-f5ccc03da22c {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-3f65d7d2-31d5-49bb-8195-e93da0ca98af tempest-ProjectMemberTests-442300356 None] snapshot_file for this snap is: volume-bd48625b-655b-4515-b08a-f5ccc03da22c.17d1fb60-d152-42a6-8f09-8ba0feb83f7e {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a696a5d-acc8-42ae-bb38-771a3d0c5086]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:52 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f65d7d2-31d5-49bb-8195-e93da0ca98af tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c.17d1fb60-d152-42a6-8f09-8ba0feb83f7e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:52 devstack sudo[106667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c.17d1fb60-d152-42a6-8f09-8ba0feb83f7e
Sep 07 18:20:52 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:53 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5 1073741824" returned: 0 in 0.426s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:53 devstack sudo[106674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5
Sep 07 18:20:53 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:53 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f65d7d2-31d5-49bb-8195-e93da0ca98af tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c.17d1fb60-d152-42a6-8f09-8ba0feb83f7e" returned: 0 in 0.382s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-3f65d7d2-31d5-49bb-8195-e93da0ca98af tempest-ProjectMemberTests-442300356 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd48625b-655b-4515-b08a-f5ccc03da22c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:20:53 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd9334f-2207-4f5c-abad-bc1146a5cc23]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f65d7d2-31d5-49bb-8195-e93da0ca98af tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:53 devstack sudo[106678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c
Sep 07 18:20:53 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:53 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5" returned: 0 in 0.262s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:20:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a53c2e-2207-468e-b1d6-8bcbcd9d6dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de199448-c3c1-48e1-a927-155438fd6ea5', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731275b0-9f5d-4a4a-a856-ad50f262aecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:53 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Volume volume-de199448-c3c1-48e1-a927-155438fd6ea5 (de199448-c3c1-48e1-a927-155438fd6ea5): created successfully
Sep 07 18:20:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (731275b0-9f5d-4a4a-a856-ad50f262aecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:53 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Flow 'volume_create_manager' (f27e505b-61d6-4bc7-9c8a-890fe75cce43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:53 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-31693a0a-47eb-4553-84ff-3abb40b867c6 tempest-ProjectReaderTests-554049164 None] Created volume successfully.
Sep 07 18:20:53 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f65d7d2-31d5-49bb-8195-e93da0ca98af tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c" returned: 0 in 0.358s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f65d7d2-31d5-49bb-8195-e93da0ca98af tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c.17d1fb60-d152-42a6-8f09-8ba0feb83f7e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:53 devstack sudo[106684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c.17d1fb60-d152-42a6-8f09-8ba0feb83f7e
Sep 07 18:20:53 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a783ef2c-0bf6-43e9-8689-507619abe216 tempest-ProjectReaderTests-554049164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a783ef2c-0bf6-43e9-8689-507619abe216 tempest-ProjectReaderTests-554049164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:53 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-a783ef2c-0bf6-43e9-8689-507619abe216 tempest-ProjectReaderTests-554049164 None] Creating offline snapshot 4669682f-2796-492b-971a-49c36488aca5 of volume de199448-c3c1-48e1-a927-155438fd6ea5 {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:20:53 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[c269a499-25e4-4a3f-8493-783cdcc6db14]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:53 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a783ef2c-0bf6-43e9-8689-507619abe216 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:53 devstack sudo[106686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5
Sep 07 18:20:53 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:53 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f65d7d2-31d5-49bb-8195-e93da0ca98af tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c.17d1fb60-d152-42a6-8f09-8ba0feb83f7e" returned: 0 in 0.373s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f65d7d2-31d5-49bb-8195-e93da0ca98af tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c.17d1fb60-d152-42a6-8f09-8ba0feb83f7e {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:54 devstack sudo[106691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c.17d1fb60-d152-42a6-8f09-8ba0feb83f7e
Sep 07 18:20:54 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:54 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a783ef2c-0bf6-43e9-8689-507619abe216 tempest-ProjectReaderTests-554049164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5" returned: 0 in 0.355s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a783ef2c-0bf6-43e9-8689-507619abe216 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5.4669682f-2796-492b-971a-49c36488aca5 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:54 devstack sudo[106696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5.4669682f-2796-492b-971a-49c36488aca5 1G
Sep 07 18:20:54 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:54 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-3f65d7d2-31d5-49bb-8195-e93da0ca98af tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c.17d1fb60-d152-42a6-8f09-8ba0feb83f7e" returned: 0 in 0.253s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f65d7d2-31d5-49bb-8195-e93da0ca98af tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-17d1fb60-d152-42a6-8f09-8ba0feb83f7e" released by "_delete_snapshot" :: held 1.452s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f65d7d2-31d5-49bb-8195-e93da0ca98af tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-bd48625b-655b-4515-b08a-f5ccc03da22c" released by "delete_snapshot" :: held 1.475s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:54 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-3f65d7d2-31d5-49bb-8195-e93da0ca98af tempest-ProjectMemberTests-442300356 None] Created reservations ['ff91576b-2465-458c-aa50-b60f8c71a743', 'e45b18a0-e0f1-4a17-8e72-fd190db1d1d8', '0c3f591d-980f-44c3-89ae-aa010d10b3cc', 'a5960eb0-834b-4808-adea-e5c8e39e3ae4'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:54 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-3f65d7d2-31d5-49bb-8195-e93da0ca98af tempest-ProjectMemberTests-442300356 None] Delete snapshot completed successfully.
Sep 07 18:20:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-3f65d7d2-31d5-49bb-8195-e93da0ca98af tempest-ProjectMemberTests-442300356 None] Lock "cinder-17d1fb60-d152-42a6-8f09-8ba0feb83f7e-delete_snapshot" released by "delete_snapshot" :: held 1.614s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:54 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a783ef2c-0bf6-43e9-8689-507619abe216 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5.4669682f-2796-492b-971a-49c36488aca5 1G" returned: 0 in 0.386s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a783ef2c-0bf6-43e9-8689-507619abe216 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de199448-c3c1-48e1-a927-155438fd6ea5 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5.4669682f-2796-492b-971a-49c36488aca5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:54 devstack sudo[106702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de199448-c3c1-48e1-a927-155438fd6ea5 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5.4669682f-2796-492b-971a-49c36488aca5
Sep 07 18:20:54 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:54 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a783ef2c-0bf6-43e9-8689-507619abe216 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de199448-c3c1-48e1-a927-155438fd6ea5 -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5.4669682f-2796-492b-971a-49c36488aca5" returned: 0 in 0.288s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:54 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-a783ef2c-0bf6-43e9-8689-507619abe216 tempest-ProjectReaderTests-554049164 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5.4669682f-2796-492b-971a-49c36488aca5 is being set with open permissions: ugo+rw
Sep 07 18:20:54 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a783ef2c-0bf6-43e9-8689-507619abe216 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5.4669682f-2796-492b-971a-49c36488aca5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:54 devstack sudo[106707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5.4669682f-2796-492b-971a-49c36488aca5
Sep 07 18:20:54 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-27a2226d-c118-4054-ad51-79ad6077f41e tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-bd48625b-655b-4515-b08a-f5ccc03da22c-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:54 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-27a2226d-c118-4054-ad51-79ad6077f41e tempest-ProjectMemberTests-442300356 None] Lock "cinder-bd48625b-655b-4515-b08a-f5ccc03da22c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-27a2226d-c118-4054-ad51-79ad6077f41e tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-quobyte-bd48625b-655b-4515-b08a-f5ccc03da22c" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-27a2226d-c118-4054-ad51-79ad6077f41e tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-bd48625b-655b-4515-b08a-f5ccc03da22c" acquired by "delete_volume" :: waited 0.023s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fe819f-f382-4789-9e88-d364f6cf65a6]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-27a2226d-c118-4054-ad51-79ad6077f41e tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:55 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a783ef2c-0bf6-43e9-8689-507619abe216 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5.4669682f-2796-492b-971a-49c36488aca5" returned: 0 in 0.263s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a783ef2c-0bf6-43e9-8689-507619abe216 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:55 devstack sudo[106711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5.info
Sep 07 18:20:55 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:55 devstack sudo[106709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c
Sep 07 18:20:55 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:55 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a783ef2c-0bf6-43e9-8689-507619abe216 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5.info" returned: 0 in 0.258s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:55 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-a783ef2c-0bf6-43e9-8689-507619abe216 tempest-ProjectReaderTests-554049164 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5.info is being set with open permissions: ugo+rw
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a783ef2c-0bf6-43e9-8689-507619abe216 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:55 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-27a2226d-c118-4054-ad51-79ad6077f41e tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c" returned: 0 in 0.361s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-27a2226d-c118-4054-ad51-79ad6077f41e tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:55 devstack sudo[106718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5.info
Sep 07 18:20:55 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:55 devstack sudo[106720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c
Sep 07 18:20:55 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:55 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-a783ef2c-0bf6-43e9-8689-507619abe216 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5.info" returned: 0 in 0.239s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-a783ef2c-0bf6-43e9-8689-507619abe216 tempest-ProjectReaderTests-554049164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.871s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:55 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-27a2226d-c118-4054-ad51-79ad6077f41e tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-bd48625b-655b-4515-b08a-f5ccc03da22c" returned: 0 in 0.244s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-27a2226d-c118-4054-ad51-79ad6077f41e tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-bd48625b-655b-4515-b08a-f5ccc03da22c" released by "delete_volume" :: held 0.667s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:55 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-a783ef2c-0bf6-43e9-8689-507619abe216 tempest-ProjectReaderTests-554049164 None] Create snapshot completed successfully
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-27a2226d-c118-4054-ad51-79ad6077f41e tempest-ProjectMemberTests-442300356 None] Created reservations ['6d074526-3a10-4b24-b507-f5cefbde9c25', '921d394c-1705-4ba7-83c0-442ee04e97ae', '5ef135c7-8cb3-43fa-a275-4f07ec0c482d', '931eeb78-7f5d-4d47-9c31-c2d083c2a54c'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-27a2226d-c118-4054-ad51-79ad6077f41e tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-27a2226d-c118-4054-ad51-79ad6077f41e tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-27a2226d-c118-4054-ad51-79ad6077f41e tempest-ProjectMemberTests-442300356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-27a2226d-c118-4054-ad51-79ad6077f41e tempest-ProjectMemberTests-442300356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-27a2226d-c118-4054-ad51-79ad6077f41e tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-27a2226d-c118-4054-ad51-79ad6077f41e tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:55 devstack sudo[106724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:20:55 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-59d2b39c-df62-4a3f-9d56-aba808f685e0 tempest-ProjectReaderTests-554049164 None] Acquiring lock "cinder-4669682f-2796-492b-971a-49c36488aca5-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-59d2b39c-df62-4a3f-9d56-aba808f685e0 tempest-ProjectReaderTests-554049164 None] Lock "cinder-4669682f-2796-492b-971a-49c36488aca5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-59d2b39c-df62-4a3f-9d56-aba808f685e0 tempest-ProjectReaderTests-554049164 None] Acquiring lock "cinder-quobyte-de199448-c3c1-48e1-a927-155438fd6ea5" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-59d2b39c-df62-4a3f-9d56-aba808f685e0 tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-de199448-c3c1-48e1-a927-155438fd6ea5" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-59d2b39c-df62-4a3f-9d56-aba808f685e0 tempest-ProjectReaderTests-554049164 None] Acquiring lock "cinder-quobyte-4669682f-2796-492b-971a-49c36488aca5" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-59d2b39c-df62-4a3f-9d56-aba808f685e0 tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-4669682f-2796-492b-971a-49c36488aca5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:55 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-59d2b39c-df62-4a3f-9d56-aba808f685e0 tempest-ProjectReaderTests-554049164 None] Deleting offline snapshot 4669682f-2796-492b-971a-49c36488aca5 of volume de199448-c3c1-48e1-a927-155438fd6ea5 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-59d2b39c-df62-4a3f-9d56-aba808f685e0 tempest-ProjectReaderTests-554049164 None] snapshot_file for this snap is: volume-de199448-c3c1-48e1-a927-155438fd6ea5.4669682f-2796-492b-971a-49c36488aca5 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc6ff35-df63-41b7-82f7-960925c053cd]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-59d2b39c-df62-4a3f-9d56-aba808f685e0 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5.4669682f-2796-492b-971a-49c36488aca5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:56 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-27a2226d-c118-4054-ad51-79ad6077f41e tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.282s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-27a2226d-c118-4054-ad51-79ad6077f41e tempest-ProjectMemberTests-442300356 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:20:56 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-27a2226d-c118-4054-ad51-79ad6077f41e tempest-ProjectMemberTests-442300356 None] Deleted volume successfully.
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-27a2226d-c118-4054-ad51-79ad6077f41e tempest-ProjectMemberTests-442300356 None] Lock "cinder-bd48625b-655b-4515-b08a-f5ccc03da22c-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:56 devstack sudo[106727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5.4669682f-2796-492b-971a-49c36488aca5
Sep 07 18:20:56 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:56 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-59d2b39c-df62-4a3f-9d56-aba808f685e0 tempest-ProjectReaderTests-554049164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5.4669682f-2796-492b-971a-49c36488aca5" returned: 0 in 0.416s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-59d2b39c-df62-4a3f-9d56-aba808f685e0 tempest-ProjectReaderTests-554049164 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de199448-c3c1-48e1-a927-155438fd6ea5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a31a3a-b879-433f-8c0e-9f3e7723499d]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-59d2b39c-df62-4a3f-9d56-aba808f685e0 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:20:56 devstack sudo[106732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5
Sep 07 18:20:56 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Flow 'volume_create_manager' (b5d36429-ed30-442a-8ad3-36a71e816636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b6959e3-e87b-4449-976a-6b821e3f229e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b6959e3-e87b-4449-976a-6b821e3f229e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-285110534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b57e73d-067b-4a59-bebe-5ceeca6e909c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e449daccfbab4cd8ba38df886cea84bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:57Z,use_quota=True,user_id='d0204c187bcf4a5ba9582bac88f452df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1011e85-4898-4da1-a0b5-5549ef6cc9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1011e85-4898-4da1-a0b5-5549ef6cc9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71504893-c069-4cdd-b9fd-e1663a690974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71504893-c069-4cdd-b9fd-e1663a690974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b57e73d-067b-4a59-bebe-5ceeca6e909c', 'volume_name': 'volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f739535c-260a-46a5-a7c0-18f84ca0556a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f739535c-260a-46a5-a7c0-18f84ca0556a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3a354a-d119-4922-833f-2ee47abef3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:56 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Volume 1b57e73d-067b-4a59-bebe-5ceeca6e909c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c', 'volume_size': 1}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-285110534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b57e73d-067b-4a59-bebe-5ceeca6e909c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e449daccfbab4cd8ba38df886cea84bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:20:57Z,use_quota=True,user_id='d0204c187bcf4a5ba9582bac88f452df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Creating volume 1b57e73d-067b-4a59-bebe-5ceeca6e909c {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:20:56 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:56 devstack sudo[106735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c 1073741824
Sep 07 18:20:56 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:56 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-59d2b39c-df62-4a3f-9d56-aba808f685e0 tempest-ProjectReaderTests-554049164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5" returned: 0 in 0.361s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:56 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-59d2b39c-df62-4a3f-9d56-aba808f685e0 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5.4669682f-2796-492b-971a-49c36488aca5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:56 devstack sudo[106740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5.4669682f-2796-492b-971a-49c36488aca5
Sep 07 18:20:56 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:57 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c 1073741824" returned: 0 in 0.445s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:57 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:57 devstack sudo[106749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c
Sep 07 18:20:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-59d2b39c-df62-4a3f-9d56-aba808f685e0 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5.4669682f-2796-492b-971a-49c36488aca5" returned: 0 in 0.349s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:57 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-59d2b39c-df62-4a3f-9d56-aba808f685e0 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5.4669682f-2796-492b-971a-49c36488aca5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:57 devstack sudo[106751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5.4669682f-2796-492b-971a-49c36488aca5
Sep 07 18:20:57 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:57 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c" returned: 0 in 0.256s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:57 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:20:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d3a354a-d119-4922-833f-2ee47abef3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:57 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc8d34b0-4c00-473f-8489-b21563db66f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:20:57 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-59d2b39c-df62-4a3f-9d56-aba808f685e0 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5.4669682f-2796-492b-971a-49c36488aca5" returned: 0 in 0.252s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-59d2b39c-df62-4a3f-9d56-aba808f685e0 tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-4669682f-2796-492b-971a-49c36488aca5" released by "_delete_snapshot" :: held 1.489s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:57 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Volume volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c (1b57e73d-067b-4a59-bebe-5ceeca6e909c): created successfully
Sep 07 18:20:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc8d34b0-4c00-473f-8489-b21563db66f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:20:57 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Flow 'volume_create_manager' (b5d36429-ed30-442a-8ad3-36a71e816636) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:20:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-59d2b39c-df62-4a3f-9d56-aba808f685e0 tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-de199448-c3c1-48e1-a927-155438fd6ea5" released by "delete_snapshot" :: held 1.521s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:57 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-2aa429d5-5a81-4344-b68e-bd7999d88158 tempest-ProjectMemberTests-442300356 None] Created volume successfully.
Sep 07 18:20:57 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-59d2b39c-df62-4a3f-9d56-aba808f685e0 tempest-ProjectReaderTests-554049164 None] Created reservations ['ef5217d6-f076-47d6-814e-663da5d787a4', '33ffaf8c-6122-4c8e-bf6f-543e701eef57', 'f4bae6e9-f251-4a50-8132-a3eebb549dca', '4f047681-9b72-44ed-9293-0b9cbb04872f'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:57 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-59d2b39c-df62-4a3f-9d56-aba808f685e0 tempest-ProjectReaderTests-554049164 None] Delete snapshot completed successfully.
Sep 07 18:20:57 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-59d2b39c-df62-4a3f-9d56-aba808f685e0 tempest-ProjectReaderTests-554049164 None] Lock "cinder-4669682f-2796-492b-971a-49c36488aca5-delete_snapshot" released by "delete_snapshot" :: held 1.662s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b6b46538-1a3a-4dc8-971b-b2f7f33b5691 tempest-ProjectReaderTests-554049164 None] Acquiring lock "cinder-de199448-c3c1-48e1-a927-155438fd6ea5-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b6b46538-1a3a-4dc8-971b-b2f7f33b5691 tempest-ProjectReaderTests-554049164 None] Lock "cinder-de199448-c3c1-48e1-a927-155438fd6ea5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b6b46538-1a3a-4dc8-971b-b2f7f33b5691 tempest-ProjectReaderTests-554049164 None] Acquiring lock "cinder-quobyte-de199448-c3c1-48e1-a927-155438fd6ea5" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:20:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b6b46538-1a3a-4dc8-971b-b2f7f33b5691 tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-de199448-c3c1-48e1-a927-155438fd6ea5" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:20:58 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e414c284-de4b-4240-ac9c-f6b9d758cc37]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b6b46538-1a3a-4dc8-971b-b2f7f33b5691 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:58 devstack sudo[106756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5
Sep 07 18:20:58 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:58 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b6b46538-1a3a-4dc8-971b-b2f7f33b5691 tempest-ProjectReaderTests-554049164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5" returned: 0 in 0.367s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b6b46538-1a3a-4dc8-971b-b2f7f33b5691 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:58 devstack sudo[106761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5
Sep 07 18:20:58 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-db2fc18b-cebf-469f-8a76-6eab9c948fa2 tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-db2fc18b-cebf-469f-8a76-6eab9c948fa2 tempest-ProjectMemberTests-442300356 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-db2fc18b-cebf-469f-8a76-6eab9c948fa2 tempest-ProjectMemberTests-442300356 None] Creating offline snapshot 0b073d55-f860-4ac8-8196-2faeb4505b33 of volume 1b57e73d-067b-4a59-bebe-5ceeca6e909c {{(pid=87269) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 07 18:20:58 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[e027e96e-8bad-4077-a5f9-7bf3fabdfa4e]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:20:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-db2fc18b-cebf-469f-8a76-6eab9c948fa2 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:58 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b6b46538-1a3a-4dc8-971b-b2f7f33b5691 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-de199448-c3c1-48e1-a927-155438fd6ea5" returned: 0 in 0.253s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:58 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b6b46538-1a3a-4dc8-971b-b2f7f33b5691 tempest-ProjectReaderTests-554049164 None] Lock "cinder-quobyte-de199448-c3c1-48e1-a927-155438fd6ea5" released by "delete_volume" :: held 0.685s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:58 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-b6b46538-1a3a-4dc8-971b-b2f7f33b5691 tempest-ProjectReaderTests-554049164 None] Created reservations ['be24ebfd-1623-4850-975a-cfa195a75f1e', '720c925a-c2a5-489f-9479-c8209487bb08', 'be97d953-b666-4aa5-a3bb-d0396aecbbcd', '2b472674-afbb-415d-b572-344ab446de12'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:20:58 devstack sudo[106764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c
Sep 07 18:20:58 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b6b46538-1a3a-4dc8-971b-b2f7f33b5691 tempest-ProjectReaderTests-554049164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:20:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b6b46538-1a3a-4dc8-971b-b2f7f33b5691 tempest-ProjectReaderTests-554049164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:20:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b6b46538-1a3a-4dc8-971b-b2f7f33b5691 tempest-ProjectReaderTests-554049164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:20:58 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-b6b46538-1a3a-4dc8-971b-b2f7f33b5691 tempest-ProjectReaderTests-554049164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:20:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-b6b46538-1a3a-4dc8-971b-b2f7f33b5691 tempest-ProjectReaderTests-554049164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:20:58 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b6b46538-1a3a-4dc8-971b-b2f7f33b5691 tempest-ProjectReaderTests-554049164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:59 devstack sudo[106766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:20:59 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:59 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-db2fc18b-cebf-469f-8a76-6eab9c948fa2 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c" returned: 0 in 0.366s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-db2fc18b-cebf-469f-8a76-6eab9c948fa2 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c.0b073d55-f860-4ac8-8196-2faeb4505b33 1G {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:59 devstack sudo[106772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c.0b073d55-f860-4ac8-8196-2faeb4505b33 1G
Sep 07 18:20:59 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:59 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-b6b46538-1a3a-4dc8-971b-b2f7f33b5691 tempest-ProjectReaderTests-554049164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.258s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:59 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-b6b46538-1a3a-4dc8-971b-b2f7f33b5691 tempest-ProjectReaderTests-554049164 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:20:59 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-b6b46538-1a3a-4dc8-971b-b2f7f33b5691 tempest-ProjectReaderTests-554049164 None] Deleted volume successfully.
Sep 07 18:20:59 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-b6b46538-1a3a-4dc8-971b-b2f7f33b5691 tempest-ProjectReaderTests-554049164 None] Lock "cinder-de199448-c3c1-48e1-a927-155438fd6ea5-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:20:59 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-db2fc18b-cebf-469f-8a76-6eab9c948fa2 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c.0b073d55-f860-4ac8-8196-2faeb4505b33 1G" returned: 0 in 0.419s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-db2fc18b-cebf-469f-8a76-6eab9c948fa2 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c.0b073d55-f860-4ac8-8196-2faeb4505b33 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:59 devstack sudo[106778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c.0b073d55-f860-4ac8-8196-2faeb4505b33
Sep 07 18:20:59 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:20:59 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root
Sep 07 18:20:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-db2fc18b-cebf-469f-8a76-6eab9c948fa2 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c -F qcow2 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c.0b073d55-f860-4ac8-8196-2faeb4505b33" returned: 0 in 0.291s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:20:59 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-db2fc18b-cebf-469f-8a76-6eab9c948fa2 tempest-ProjectMemberTests-442300356 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c.0b073d55-f860-4ac8-8196-2faeb4505b33 is being set with open permissions: ugo+rw
Sep 07 18:20:59 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-db2fc18b-cebf-469f-8a76-6eab9c948fa2 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c.0b073d55-f860-4ac8-8196-2faeb4505b33 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:20:59 devstack sudo[106783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c.0b073d55-f860-4ac8-8196-2faeb4505b33
Sep 07 18:20:59 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:21:00 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root
Sep 07 18:21:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-db2fc18b-cebf-469f-8a76-6eab9c948fa2 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c.0b073d55-f860-4ac8-8196-2faeb4505b33" returned: 0 in 0.267s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:21:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-db2fc18b-cebf-469f-8a76-6eab9c948fa2 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:21:00 devstack sudo[106786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c.info
Sep 07 18:21:00 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:21:00 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root
Sep 07 18:21:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-db2fc18b-cebf-469f-8a76-6eab9c948fa2 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c.info" returned: 0 in 0.254s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:21:00 devstack cinder-volume[87269]: WARNING cinder.volume.drivers.remotefs [None req-db2fc18b-cebf-469f-8a76-6eab9c948fa2 tempest-ProjectMemberTests-442300356 None] /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c.info is being set with open permissions: ugo+rw
Sep 07 18:21:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-db2fc18b-cebf-469f-8a76-6eab9c948fa2 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c.info {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:21:00 devstack sudo[106789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c.info
Sep 07 18:21:00 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:21:00 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root
Sep 07 18:21:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-db2fc18b-cebf-469f-8a76-6eab9c948fa2 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c.info" returned: 0 in 0.264s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:21:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-db2fc18b-cebf-469f-8a76-6eab9c948fa2 tempest-ProjectMemberTests-442300356 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.952s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:21:00 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-db2fc18b-cebf-469f-8a76-6eab9c948fa2 tempest-ProjectMemberTests-442300356 None] Create snapshot completed successfully
Sep 07 18:21:00 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:21:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:21:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:21:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:21:00 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:21:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:21:00 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:21:00 devstack sudo[106792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:21:00 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:21:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-460f7573-18ba-45a4-9f0b-4e7659a84878 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-0b073d55-f860-4ac8-8196-2faeb4505b33-delete_snapshot" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:21:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-460f7573-18ba-45a4-9f0b-4e7659a84878 tempest-ProjectMemberTests-442300356 None] Lock "cinder-0b073d55-f860-4ac8-8196-2faeb4505b33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:21:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-460f7573-18ba-45a4-9f0b-4e7659a84878 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-quobyte-1b57e73d-067b-4a59-bebe-5ceeca6e909c" by "delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:21:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-460f7573-18ba-45a4-9f0b-4e7659a84878 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-1b57e73d-067b-4a59-bebe-5ceeca6e909c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:21:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-460f7573-18ba-45a4-9f0b-4e7659a84878 tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-quobyte-0b073d55-f860-4ac8-8196-2faeb4505b33" by "_delete_snapshot" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:21:01 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-460f7573-18ba-45a4-9f0b-4e7659a84878 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-0b073d55-f860-4ac8-8196-2faeb4505b33" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:21:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-460f7573-18ba-45a4-9f0b-4e7659a84878 tempest-ProjectMemberTests-442300356 None] Deleting offline snapshot 0b073d55-f860-4ac8-8196-2faeb4505b33 of volume 1b57e73d-067b-4a59-bebe-5ceeca6e909c {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 07 18:21:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-460f7573-18ba-45a4-9f0b-4e7659a84878 tempest-ProjectMemberTests-442300356 None] snapshot_file for this snap is: volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c.0b073d55-f860-4ac8-8196-2faeb4505b33 {{(pid=87269) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 07 18:21:01 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root
Sep 07 18:21:01 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5c3a54-22a3-49d0-bd0d-10655448e7cc]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:21:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-460f7573-18ba-45a4-9f0b-4e7659a84878 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c.0b073d55-f860-4ac8-8196-2faeb4505b33 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:21:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.313s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:21:01 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:21:01 devstack cinder-volume[87269]: DEBUG oslo_service.periodic_task [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] Running periodic task VolumeManager._thread_info {{(pid=87269) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 07 18:21:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread count: 28 {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 07 18:21:01 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f8931292-bb07-4fda-9c2c-2a91b77d7750 None None] thread info: [<_MainThread(MainThread, started 137533762306176)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137533650971072)>, <Thread(Thread-3 (stat_writer), started daemon 137533647226880)>, <Thread(Rabbit-heartbeat, started daemon 137533647437120)>, <Thread(Thread-5 (_runner), started daemon 137533648120896)>, <Thread(Thread-7 (_runner), started daemon 137533648182592)>, <Thread(fd_logger, started daemon 137533644336576)>, <Thread(privsep_reader, started daemon 137533643255424)>, <Thread(tpool_thread_0, started daemon 137533635446464)>, <Thread(tpool_thread_1, started daemon 137533627053760)>, <Thread(tpool_thread_2, started daemon 137533618661056)>, <Thread(tpool_thread_3, started daemon 137533610251968)>, <Thread(tpool_thread_4, started daemon 137533601842880)>, <Thread(tpool_thread_5, started daemon 137533593433792)>, <Thread(tpool_thread_6, started daemon 137533585024704)>, <Thread(tpool_thread_7, started daemon 137533576615616)>, <Thread(tpool_thread_8, started daemon 137533568206528)>, <Thread(tpool_thread_9, started daemon 137533559797440)>, <Thread(tpool_thread_10, started daemon 137533551388352)>, <Thread(tpool_thread_11, started daemon 137533542979264)>, <Thread(tpool_thread_12, started daemon 137533534570176)>, <Thread(tpool_thread_13, started daemon 137533526161088)>, <Thread(tpool_thread_14, started daemon 137533517752000)>, <Thread(tpool_thread_15, started daemon 137533509342912)>, <Thread(tpool_thread_16, started daemon 137533500933824)>, <Thread(tpool_thread_17, started daemon 137533492524736)>, <Thread(tpool_thread_18, started daemon 137533484115648)>, <Thread(tpool_thread_19, started daemon 137533475706560)>] {{(pid=87269) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 07 18:21:01 devstack sudo[106795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c.0b073d55-f860-4ac8-8196-2faeb4505b33
Sep 07 18:21:01 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:21:01 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root
Sep 07 18:21:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-460f7573-18ba-45a4-9f0b-4e7659a84878 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c.0b073d55-f860-4ac8-8196-2faeb4505b33" returned: 0 in 0.358s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:21:01 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-460f7573-18ba-45a4-9f0b-4e7659a84878 tempest-ProjectMemberTests-442300356 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87269) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 07 18:21:01 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e693e11-09aa-4407-838a-2831fc19847a]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:21:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-460f7573-18ba-45a4-9f0b-4e7659a84878 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:21:01 devstack sudo[106800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c
Sep 07 18:21:01 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:21:01 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root
Sep 07 18:21:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-460f7573-18ba-45a4-9f0b-4e7659a84878 tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c" returned: 0 in 0.359s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:21:01 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-460f7573-18ba-45a4-9f0b-4e7659a84878 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c.0b073d55-f860-4ac8-8196-2faeb4505b33 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:21:01 devstack sudo[106806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c.0b073d55-f860-4ac8-8196-2faeb4505b33
Sep 07 18:21:01 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:21:02 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root
Sep 07 18:21:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-460f7573-18ba-45a4-9f0b-4e7659a84878 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c.0b073d55-f860-4ac8-8196-2faeb4505b33" returned: 0 in 0.347s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:21:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-460f7573-18ba-45a4-9f0b-4e7659a84878 tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c.0b073d55-f860-4ac8-8196-2faeb4505b33 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:21:02 devstack sudo[106811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c.0b073d55-f860-4ac8-8196-2faeb4505b33
Sep 07 18:21:02 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:21:02 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root
Sep 07 18:21:02 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-460f7573-18ba-45a4-9f0b-4e7659a84878 tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c.0b073d55-f860-4ac8-8196-2faeb4505b33" returned: 0 in 0.253s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:21:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-460f7573-18ba-45a4-9f0b-4e7659a84878 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-0b073d55-f860-4ac8-8196-2faeb4505b33" released by "_delete_snapshot" :: held 1.434s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:21:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-460f7573-18ba-45a4-9f0b-4e7659a84878 tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-1b57e73d-067b-4a59-bebe-5ceeca6e909c" released by "delete_snapshot" :: held 1.462s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:21:02 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-460f7573-18ba-45a4-9f0b-4e7659a84878 tempest-ProjectMemberTests-442300356 None] Created reservations ['b9f6ac83-625a-47d3-be6b-c496a016d9ac', '2f6eab04-9783-48b7-a8ad-b582fbec413a', 'f21593b8-d019-4f27-9290-2c50b47a770c', '89f5e0de-42bc-4771-8465-d90a0dae05d1'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:21:02 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-460f7573-18ba-45a4-9f0b-4e7659a84878 tempest-ProjectMemberTests-442300356 None] Delete snapshot completed successfully.
Sep 07 18:21:02 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-460f7573-18ba-45a4-9f0b-4e7659a84878 tempest-ProjectMemberTests-442300356 None] Lock "cinder-0b073d55-f860-4ac8-8196-2faeb4505b33-delete_snapshot" released by "delete_snapshot" :: held 1.606s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:21:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e20a5853-1560-4111-9b61-9f8943350f8e tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-1b57e73d-067b-4a59-bebe-5ceeca6e909c-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:21:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e20a5853-1560-4111-9b61-9f8943350f8e tempest-ProjectMemberTests-442300356 None] Lock "cinder-1b57e73d-067b-4a59-bebe-5ceeca6e909c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:21:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e20a5853-1560-4111-9b61-9f8943350f8e tempest-ProjectMemberTests-442300356 None] Acquiring lock "cinder-quobyte-1b57e73d-067b-4a59-bebe-5ceeca6e909c" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:21:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e20a5853-1560-4111-9b61-9f8943350f8e tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-1b57e73d-067b-4a59-bebe-5ceeca6e909c" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:21:03 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7820feb-b798-4875-b36b-47a711cfd627]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:21:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e20a5853-1560-4111-9b61-9f8943350f8e tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:21:03 devstack sudo[106814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c
Sep 07 18:21:03 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:21:03 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root
Sep 07 18:21:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e20a5853-1560-4111-9b61-9f8943350f8e tempest-ProjectMemberTests-442300356 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c" returned: 0 in 0.357s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:21:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e20a5853-1560-4111-9b61-9f8943350f8e tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:21:03 devstack sudo[106819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c
Sep 07 18:21:03 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:21:03 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root
Sep 07 18:21:03 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e20a5853-1560-4111-9b61-9f8943350f8e tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-1b57e73d-067b-4a59-bebe-5ceeca6e909c" returned: 0 in 0.274s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:21:03 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e20a5853-1560-4111-9b61-9f8943350f8e tempest-ProjectMemberTests-442300356 None] Lock "cinder-quobyte-1b57e73d-067b-4a59-bebe-5ceeca6e909c" released by "delete_volume" :: held 0.695s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:21:04 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-e20a5853-1560-4111-9b61-9f8943350f8e tempest-ProjectMemberTests-442300356 None] Created reservations ['54e3a799-d947-4449-9b4c-bcb07b81d7c1', '216e6ff7-0370-452a-b417-87485d769266', '14834cd1-87cf-429d-9e1f-d05082778155', '4346a482-7a70-4dfb-b872-b816f347f185'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:21:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e20a5853-1560-4111-9b61-9f8943350f8e tempest-ProjectMemberTests-442300356 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:21:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e20a5853-1560-4111-9b61-9f8943350f8e tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:21:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e20a5853-1560-4111-9b61-9f8943350f8e tempest-ProjectMemberTests-442300356 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:21:04 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-e20a5853-1560-4111-9b61-9f8943350f8e tempest-ProjectMemberTests-442300356 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:21:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-e20a5853-1560-4111-9b61-9f8943350f8e tempest-ProjectMemberTests-442300356 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:21:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e20a5853-1560-4111-9b61-9f8943350f8e tempest-ProjectMemberTests-442300356 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:21:04 devstack sudo[106822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:21:04 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:21:04 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root
Sep 07 18:21:04 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-e20a5853-1560-4111-9b61-9f8943350f8e tempest-ProjectMemberTests-442300356 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.268s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:21:04 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-e20a5853-1560-4111-9b61-9f8943350f8e tempest-ProjectMemberTests-442300356 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:21:04 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-e20a5853-1560-4111-9b61-9f8943350f8e tempest-ProjectMemberTests-442300356 None] Deleted volume successfully.
Sep 07 18:21:04 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-e20a5853-1560-4111-9b61-9f8943350f8e tempest-ProjectMemberTests-442300356 None] Lock "cinder-1b57e73d-067b-4a59-bebe-5ceeca6e909c-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Flow 'volume_create_manager' (3270a93d-b5ef-4e82-b0c3-d3a0ab46a6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f87ce6b-c990-44ce-9591-2625bc1d5d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f87ce6b-c990-44ce-9591-2625bc1d5d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-422039712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8463ea47-50f4-4214-8dca-7b70420efa64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f096c877897646518c47dde2578c4ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:21:08Z,use_quota=True,user_id='9031b959b43543e697b0e07f7baacb12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb660c3e-4686-4942-b51c-6a17a73702d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb660c3e-4686-4942-b51c-6a17a73702d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952496e5-fbb6-4573-a78d-04eb3726657b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (952496e5-fbb6-4573-a78d-04eb3726657b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8463ea47-50f4-4214-8dca-7b70420efa64', 'volume_name': 'volume-8463ea47-50f4-4214-8dca-7b70420efa64', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d552e53-ae2d-4ae9-9fae-a7b3e9e5fab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d552e53-ae2d-4ae9-9fae-a7b3e9e5fab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec34f58-51df-413d-8583-615a61021a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:21:08 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Volume 8463ea47-50f4-4214-8dca-7b70420efa64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8463ea47-50f4-4214-8dca-7b70420efa64', 'volume_size': 1}
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-422039712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8463ea47-50f4-4214-8dca-7b70420efa64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f096c877897646518c47dde2578c4ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:21:08Z,use_quota=True,user_id='9031b959b43543e697b0e07f7baacb12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Creating volume 8463ea47-50f4-4214-8dca-7b70420efa64 {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:21:08 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8463ea47-50f4-4214-8dca-7b70420efa64 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:21:08 devstack sudo[106826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8463ea47-50f4-4214-8dca-7b70420efa64 1073741824
Sep 07 18:21:08 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:21:08 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8463ea47-50f4-4214-8dca-7b70420efa64 1073741824" returned: 0 in 0.452s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8463ea47-50f4-4214-8dca-7b70420efa64 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:21:08 devstack sudo[106832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8463ea47-50f4-4214-8dca-7b70420efa64
Sep 07 18:21:08 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:21:08 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8463ea47-50f4-4214-8dca-7b70420efa64" returned: 0 in 0.279s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ec34f58-51df-413d-8583-615a61021a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8463ea47-50f4-4214-8dca-7b70420efa64', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8debb6e9-c8ef-4f06-98a8-d968413bf6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:21:08 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Volume volume-8463ea47-50f4-4214-8dca-7b70420efa64 (8463ea47-50f4-4214-8dca-7b70420efa64): created successfully
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8debb6e9-c8ef-4f06-98a8-d968413bf6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:21:08 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Flow 'volume_create_manager' (3270a93d-b5ef-4e82-b0c3-d3a0ab46a6f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:21:08 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-f9d78c16-3061-4e56-8bc1-de46b49a52b3 tempest-ProjectReaderTests-11931544 None] Created volume successfully.
Sep 07 18:21:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1b2e8943-4fbe-4d1d-bdfd-96f278057331 tempest-ProjectReaderTests-11931544 None] Acquiring lock "cinder-8463ea47-50f4-4214-8dca-7b70420efa64-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:21:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1b2e8943-4fbe-4d1d-bdfd-96f278057331 tempest-ProjectReaderTests-11931544 None] Lock "cinder-8463ea47-50f4-4214-8dca-7b70420efa64-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:21:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1b2e8943-4fbe-4d1d-bdfd-96f278057331 tempest-ProjectReaderTests-11931544 None] Acquiring lock "cinder-quobyte-8463ea47-50f4-4214-8dca-7b70420efa64" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:21:09 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1b2e8943-4fbe-4d1d-bdfd-96f278057331 tempest-ProjectReaderTests-11931544 None] Lock "cinder-quobyte-8463ea47-50f4-4214-8dca-7b70420efa64" acquired by "delete_volume" :: waited 0.016s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:21:09 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c066662-00f3-4487-acb4-1703588adac3]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:21:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1b2e8943-4fbe-4d1d-bdfd-96f278057331 tempest-ProjectReaderTests-11931544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8463ea47-50f4-4214-8dca-7b70420efa64 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:21:09 devstack sudo[106835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8463ea47-50f4-4214-8dca-7b70420efa64
Sep 07 18:21:09 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:21:09 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root
Sep 07 18:21:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1b2e8943-4fbe-4d1d-bdfd-96f278057331 tempest-ProjectReaderTests-11931544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8463ea47-50f4-4214-8dca-7b70420efa64" returned: 0 in 0.364s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:21:09 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1b2e8943-4fbe-4d1d-bdfd-96f278057331 tempest-ProjectReaderTests-11931544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8463ea47-50f4-4214-8dca-7b70420efa64 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:21:09 devstack sudo[106841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8463ea47-50f4-4214-8dca-7b70420efa64
Sep 07 18:21:09 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:21:10 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root
Sep 07 18:21:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1b2e8943-4fbe-4d1d-bdfd-96f278057331 tempest-ProjectReaderTests-11931544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-8463ea47-50f4-4214-8dca-7b70420efa64" returned: 0 in 0.249s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:21:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1b2e8943-4fbe-4d1d-bdfd-96f278057331 tempest-ProjectReaderTests-11931544 None] Lock "cinder-quobyte-8463ea47-50f4-4214-8dca-7b70420efa64" released by "delete_volume" :: held 0.659s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:21:10 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-1b2e8943-4fbe-4d1d-bdfd-96f278057331 tempest-ProjectReaderTests-11931544 None] Created reservations ['a609e4d2-a46c-45b4-8cea-dad78ec0bdf1', '98cebcb4-a722-4bd6-a9db-c7b2974515c9', '17a2cdc4-b338-4890-913d-72ee9fc022ec', '78a55836-f1c1-4930-bf44-ae821601df8b'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:21:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1b2e8943-4fbe-4d1d-bdfd-96f278057331 tempest-ProjectReaderTests-11931544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:21:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1b2e8943-4fbe-4d1d-bdfd-96f278057331 tempest-ProjectReaderTests-11931544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:21:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1b2e8943-4fbe-4d1d-bdfd-96f278057331 tempest-ProjectReaderTests-11931544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:21:10 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-1b2e8943-4fbe-4d1d-bdfd-96f278057331 tempest-ProjectReaderTests-11931544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:21:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-1b2e8943-4fbe-4d1d-bdfd-96f278057331 tempest-ProjectReaderTests-11931544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:21:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1b2e8943-4fbe-4d1d-bdfd-96f278057331 tempest-ProjectReaderTests-11931544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:21:10 devstack sudo[106844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:21:10 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:21:10 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root
Sep 07 18:21:10 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-1b2e8943-4fbe-4d1d-bdfd-96f278057331 tempest-ProjectReaderTests-11931544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.261s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:21:10 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-1b2e8943-4fbe-4d1d-bdfd-96f278057331 tempest-ProjectReaderTests-11931544 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:21:10 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-1b2e8943-4fbe-4d1d-bdfd-96f278057331 tempest-ProjectReaderTests-11931544 None] Deleted volume successfully.
Sep 07 18:21:10 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-1b2e8943-4fbe-4d1d-bdfd-96f278057331 tempest-ProjectReaderTests-11931544 None] Lock "cinder-8463ea47-50f4-4214-8dca-7b70420efa64-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:21:10 devstack cinder-volume[87269]: DEBUG cinder.volume.flows.manager.create_volume [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87269) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Flow 'volume_create_manager' (1cad7c36-5839-4e9d-bffc-e6272094eaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cafa802a-4dfa-4cdf-a5b6-1666aa831b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cafa802a-4dfa-4cdf-a5b6-1666aa831b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-884692403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd94e915-dd6b-4bdd-b0ba-883db4d184fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f096c877897646518c47dde2578c4ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:21:11Z,use_quota=True,user_id='9031b959b43543e697b0e07f7baacb12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b26e63-2b52-4619-8f50-d0fccaafdf11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b26e63-2b52-4619-8f50-d0fccaafdf11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932a7c65-18f2-42de-8ee5-70af36d34ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932a7c65-18f2-42de-8ee5-70af36d34ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd94e915-dd6b-4bdd-b0ba-883db4d184fd', 'volume_name': 'volume-cd94e915-dd6b-4bdd-b0ba-883db4d184fd', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e0fb2d-ac46-490f-965f-ddd9bd6d309a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e0fb2d-ac46-490f-965f-ddd9bd6d309a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a5d5c6-222a-46a4-89d1-2729f686d015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:21:11 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Volume cd94e915-dd6b-4bdd-b0ba-883db4d184fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd94e915-dd6b-4bdd-b0ba-883db4d184fd', 'volume_size': 1}
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7d160c5bb590>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-07T16:21:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-884692403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd94e915-dd6b-4bdd-b0ba-883db4d184fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f096c877897646518c47dde2578c4ba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T16:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T16:21:11Z,use_quota=True,user_id='9031b959b43543e697b0e07f7baacb12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5bd72801-0e37-4770-8c09-2051a43393dc),volume_type_id=5bd72801-0e37-4770-8c09-2051a43393dc)}" {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.remotefs [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Creating volume cd94e915-dd6b-4bdd-b0ba-883db4d184fd {{(pid=87269) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Selected osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d as target Quobyte volume. {{(pid=87269) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 07 18:21:11 devstack cinder-volume[87269]: INFO cinder.volume.drivers.remotefs [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] casted to osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cd94e915-dd6b-4bdd-b0ba-883db4d184fd 1073741824 {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:21:11 devstack sudo[106847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cd94e915-dd6b-4bdd-b0ba-883db4d184fd 1073741824
Sep 07 18:21:11 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:21:11 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cd94e915-dd6b-4bdd-b0ba-883db4d184fd 1073741824" returned: 0 in 0.411s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cd94e915-dd6b-4bdd-b0ba-883db4d184fd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:21:11 devstack sudo[106886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cd94e915-dd6b-4bdd-b0ba-883db4d184fd
Sep 07 18:21:11 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:21:11 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cd94e915-dd6b-4bdd-b0ba-883db4d184fd" returned: 0 in 0.246s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'} {{(pid=87269) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5a5d5c6-222a-46a4-89d1-2729f686d015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd94e915-dd6b-4bdd-b0ba-883db4d184fd', 'volume_size': 1}' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89fdd471-ee69-4162-aff7-b2e1d5f77cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 07 18:21:11 devstack cinder-volume[87269]: INFO cinder.volume.flows.manager.create_volume [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Volume volume-cd94e915-dd6b-4bdd-b0ba-883db4d184fd (cd94e915-dd6b-4bdd-b0ba-883db4d184fd): created successfully
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89fdd471-ee69-4162-aff7-b2e1d5f77cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87269) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG cinder.volume.manager [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Flow 'volume_create_manager' (1cad7c36-5839-4e9d-bffc-e6272094eaf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87269) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 07 18:21:11 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-95c90428-c78b-4ce7-b1fb-242f02c0fd8f tempest-ProjectReaderTests-11931544 None] Created volume successfully.
Sep 07 18:21:11 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8a78a248-d613-420f-bf37-00033b81f450 tempest-ProjectReaderTests-11931544 None] Acquiring lock "cinder-cd94e915-dd6b-4bdd-b0ba-883db4d184fd-delete_volume" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:21:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8a78a248-d613-420f-bf37-00033b81f450 tempest-ProjectReaderTests-11931544 None] Lock "cinder-cd94e915-dd6b-4bdd-b0ba-883db4d184fd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:21:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8a78a248-d613-420f-bf37-00033b81f450 tempest-ProjectReaderTests-11931544 None] Acquiring lock "cinder-quobyte-cd94e915-dd6b-4bdd-b0ba-883db4d184fd" by "delete_volume" {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 07 18:21:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8a78a248-d613-420f-bf37-00033b81f450 tempest-ProjectReaderTests-11931544 None] Lock "cinder-quobyte-cd94e915-dd6b-4bdd-b0ba-883db4d184fd" acquired by "delete_volume" :: waited 0.022s {{(pid=87269) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 07 18:21:12 devstack cinder-volume[87269]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb21ae2-43e5-43c0-a3a1-cf8e0c59f934]: (4, 'qcow2') {{(pid=88355) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 07 18:21:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8a78a248-d613-420f-bf37-00033b81f450 tempest-ProjectReaderTests-11931544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cd94e915-dd6b-4bdd-b0ba-883db4d184fd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:21:12 devstack sudo[106891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cd94e915-dd6b-4bdd-b0ba-883db4d184fd
Sep 07 18:21:12 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:21:12 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root
Sep 07 18:21:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8a78a248-d613-420f-bf37-00033b81f450 tempest-ProjectReaderTests-11931544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cd94e915-dd6b-4bdd-b0ba-883db4d184fd" returned: 0 in 0.347s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:21:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8a78a248-d613-420f-bf37-00033b81f450 tempest-ProjectReaderTests-11931544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cd94e915-dd6b-4bdd-b0ba-883db4d184fd {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:21:12 devstack sudo[106896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cd94e915-dd6b-4bdd-b0ba-883db4d184fd
Sep 07 18:21:12 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:21:12 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root
Sep 07 18:21:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8a78a248-d613-420f-bf37-00033b81f450 tempest-ProjectReaderTests-11931544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a/volume-cd94e915-dd6b-4bdd-b0ba-883db4d184fd" returned: 0 in 0.242s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:21:12 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8a78a248-d613-420f-bf37-00033b81f450 tempest-ProjectReaderTests-11931544 None] Lock "cinder-quobyte-cd94e915-dd6b-4bdd-b0ba-883db4d184fd" released by "delete_volume" :: held 0.630s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:21:12 devstack cinder-volume[87269]: DEBUG cinder.quota [None req-8a78a248-d613-420f-bf37-00033b81f450 tempest-ProjectReaderTests-11931544 None] Created reservations ['08009d3e-65dd-4a4b-9479-938d2c8b79cf', '3bf1fbd0-0605-4fa2-8a39-44abedbfe3e9', 'ec40022d-1769-4fe3-832d-61e0771b142d', '29ec6fa5-d9a9-4d15-93a1-0274ed55247a'] {{(pid=87269) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 07 18:21:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8a78a248-d613-420f-bf37-00033b81f450 tempest-ProjectReaderTests-11931544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 07 18:21:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8a78a248-d613-420f-bf37-00033b81f450 tempest-ProjectReaderTests-11931544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 07 18:21:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8a78a248-d613-420f-bf37-00033b81f450 tempest-ProjectReaderTests-11931544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d': None} {{(pid=87269) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 07 18:21:12 devstack cinder-volume[87269]: DEBUG cinder.volume.drivers.quobyte [None req-8a78a248-d613-420f-bf37-00033b81f450 tempest-ProjectReaderTests-11931544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30849a10-7c66-45e3-af22-8f1e57e28b4d'] {{(pid=87269) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 07 18:21:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.lockutils [None req-8a78a248-d613-420f-bf37-00033b81f450 tempest-ProjectReaderTests-11931544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87269) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 07 18:21:12 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8a78a248-d613-420f-bf37-00033b81f450 tempest-ProjectReaderTests-11931544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 07 18:21:12 devstack sudo[106899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a
Sep 07 18:21:12 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 07 18:21:13 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root
Sep 07 18:21:13 devstack cinder-volume[87269]: DEBUG oslo_concurrency.processutils [None req-8a78a248-d613-420f-bf37-00033b81f450 tempest-ProjectReaderTests-11931544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/20d118255107cace2cb9f2b86b59214a" returned: 0 in 0.250s {{(pid=87269) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 07 18:21:13 devstack cinder-volume[87269]: DEBUG cinder.manager [None req-8a78a248-d613-420f-bf37-00033b81f450 tempest-ProjectReaderTests-11931544 None] Notifying Schedulers of capabilities ... {{(pid=87269) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 07 18:21:13 devstack cinder-volume[87269]: INFO cinder.volume.manager [None req-8a78a248-d613-420f-bf37-00033b81f450 tempest-ProjectReaderTests-11931544 None] Deleted volume successfully.
Sep 07 18:21:13 devstack cinder-volume[87269]: DEBUG cinder.coordination [None req-8a78a248-d613-420f-bf37-00033b81f450 tempest-ProjectReaderTests-11931544 None] Lock "cinder-cd94e915-dd6b-4bdd-b0ba-883db4d184fd-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=87269) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 07 18:21:22 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=50,cinder:INSERT=19,cinder:UPDATE=87,cinder:DELETE=6 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 07 18:21:23 devstack cinder-volume[87269]: DEBUG dbcounter [-] [87269] Writing DB stats cinder:SELECT=65,cinder:INSERT=24,cinder:UPDATE=73,cinder:DELETE=7 {{(pid=87269) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}